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CONTACT  REPORT 


COMPANY : 

IBM  CORPORATION 

INIT: 

RDW 

NAME : 

Max  Fiszer 

I M I T : 

NH 

TITLE: 

Manager,  Project  Office 

CONTACT : 

11/18/88 

ADDRESS : 

Programming  Systems  Division 
2800  Sand  Hill  Road 
Meno  Park,  CA  94025 

REASON 

WRITTEN: 
TYPE : 

11/18/88 

F'hone 

RELATING 

PHONE : 

858-3012  

Sales 

CUSTOM 

==========  COMMENTS  ============= 


11/17/88  — Max  was  referred  to  us  by  Jim  Gates  of  IBM.  (See  PAC 
contact  report  dated  11/3.)  He  is  manager  of  the  Project  Office  for 
Knowledge  Based  Systems  in  the  Programming  Systems  Division  of  IBM. 
While  that  office  is  not  responsible  for  the  development  or  acquisition 
of  particular  Knowledge  based  software  products,  it  is  responsible  for 
everything  else  including  support,  marketing,  etc.  ...  ^ 


Max  indicated  that  they  were  focusing  on  three  products,  all  mainframe 
based,  that  are  directed  at  three  different  types  of  users.  The  first, 
Expert  Systems  Environment,  is  a tool  directed  at  end  users.  The 
second,  Knowledge  Tool,  is  PL1  based  and  designed  to  support  DP  " ^ 
professionals.  The  third,  is  or  will  be  purchased  and  is  called  "KEY", 
a product  of  Intel licorp.  When  released  by  IBM  this  tool 
called  "IBM  KEY"  and  is  a LISP  oriented  product  primarily 
supporting  AI  and  Expert  Systems  applications  developers, 
products  will  be  delivered  over  networks. 


will  be 
aimed  at 

Al  1 


three 


Max  indicated  that  IBM  was  making  a very  large  investment  in  knowledge 
based  systems.  There  are  over  100  people  involved  in  Menlo  Park,  and 
probably  300  hundred  more  if  you  count  the  efforts  in  Bethesda, 
Gaithersberg , and  IBM's  prime  research  facility.  Their  strategy  is  to 
have  tools  which  can  be  either  easily  integrated  directly  into  other 
applications,  or  which  support  the  development  of  knowledge  based 
applications  that  can  be  easily  integrated  into  other  applications 
environments.  He  estimates  that  there  are  perhaps  500  installations  of 
host  based  knowledge  based  software  environments,  and  perhaps  20%  of 
these  have  production  applications  of  some  sort  or  another. 


It's  IBM's  feeling  that  there  are  probably  about  2000  instal lations  of 
similary  software  at  the  workstation  (Sun,  Applo)  level;  and  about 
10000  installations  at  the  PC  level.  IBM  also  feels  that  the  Service 
Sector  is  taking  the  lead  in  the  application  of  this  type  of 
technology  and  cited  the  insurance  industry  in  particular. 


IBM  is  potentially  interested  in  having  INPUT  investigate  a number  of 
items;  including: 


1.  Users  (all  three  classes)  reactions  to  the  software  systems  they 
are  currently  using  ( I BM  and  Non-IBM), 

2.  Users  impressions  of  IBM ' s mainframe  approach  to  providing  tools 
that  will  facilitate  the  integration  of  knowledge  based 
applications  into  the  production  environment. 

In  the  first  category  they  would  like  to  know:  What  tools  are  they 
using,  (and  presumably  for  what  kinds  of  applications),  their 
perceptions  of  the  strengths  and  weaknesses  of  the  tools,  etc. 

I discussed  INPUT'S  approach  to  Custom  Work  and  touted  Eienny  White's 
experience  in  this  particular  area.  Nancy  reviewed  INPUT'S  general 
capabilities  and  gave  Max  some?  literature  and  a report  to  look  over. 

I agreed  to  prepare  a preliminary  work  statement  of  what  we  might  do 
to  address  IE-iM's  requirements,  and  get  it  to  Max  by  Monday.  This  does 
not  need  to  be  a formal  proposal,  but  should  include  some  feeling  for 
a ball  park  price.  I suggested  that  he  should  follow  up  with  Denny 
Whi te . 

I believe  that  they  have  money  to  spend  this  year  and  if  we  come  up 
with  a price  that  is  perhaps  to  large,  we  could  segment  the  project  to 
get  it  into  two  different  budget  periods. 
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(415)  961-3300 

Telex  171407 

FAX  (415)  961-3966 
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N [product]  strengths  and  weaknesses 

[Note:  "Hidden"  straw-man  list  (at  inconsistent  levels  of  detail)  of 
features/functions  for  both  strengths/weaknesses  section  and  "feature 
wish  list"  section,  below.  Keep  emphasis  on  higher-level,  strategic 
functions  - underlined] 


DVLP  [a].  Development  by  multiple  developers  [CLIENT  Fax  pg.  8,  item  A] 

Graphic  approach  to  knowledge-base  construction  [B] 

List  processing  capabilities  [E] 

Processing  of  sets  [F] 

Support  of  object  "types"  [G] 

Support  of  object  "status"  [J] 

Support  of  file  browsing  [L] 

Support/calculation  of  date  and  time  datatypes  [Q] 

? Running  system  commands  [M]  — c ' 

? VocaM^ry ? [H]  x \ T 

? Defining  "noise  words"  [O]  ^ 0 

Determining  cost  of  a parameter  triggering  [P] 

Developing  on  the  mainframe  [-] 

Developing  on  a PC  or  PS/2  [X] 

Developing  on  many  platforms,  based  on  Unix  or  C [-] 

Ability  to  embed  in  other  applications  [-] 


PRDN 


Running  production  on  the  mainframe  [-] 

Running  production  on  a PC  or  PS/2  [Y] 

Running  production  on  PCs  and  mainframe,  under 
"cooperative  processing"  f-l 

Running  production  on  many  platforms,  based  on  Unix  or  C [-] 
Output  of  reports  [C] 

Processing  of  records  from  a database  [D] 

Password  security  [I] 

/C  Writing  to  outside  disk  files  from  knowledge  base  [Kj 

Access  to  memory  used  in  current  state  of  knowledge  base  [N] 
Production  can  run  under  IBM  CICSA/S  [R] 

Production  can  run  under  IBM  IMS  A/S  [S] 

Sharing  application  among  multiple  central  processors  [U] 
Access  to  DL/1  [?]  databases  and  VSAM  files  [T] 


(*•> 
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DB2  command  support  [VI 
SOL  support  fWl 
SAA  support  ffZJJ 

From  the  perspective  of  your  experience  with [product],  what  are 

its  main  strengths,  and  why  is  each  important  to  you? 

[Note:  Try  to  cross-reference  to  list  above] 


s-1:  

Why  important? 

s-2:  

Why  important? 

s-3:  

Why  important? 

s-4:  

Why  important? 

From  the  perspective  of  your  experience  with [product],  what  are 

its  main  weaknesses,  and  why  is  each  important  to  you? 

[Note:  Try  to  cross-reference  to  list  above] 

w-1:  

Why  important? 

w-2:  

Why  important? 

w-3:  

Why  important? 

w-4:  

Why  important? 
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ASAP  USFR  Snpvry 

Summary 


The  survey  was  divided  into  four  sections: 

I.  User  Profile 

II.  Marketing  Profile 

III.  Performance/Satisfaction 
IV-  Features/Functions 

A summary  of  the  results  from  each  section  follows. 


I.  User  Profile 


The  following  eight  customers  were  surveyed: 


Company 


Type  of  business 


Boole  & Babbage 
Boeing 

Arthur  Anderson 
Northern  Telecom 
McCormack  & Dodge 
Rohm  & Haas 
Provident 
MSA 


Mainframe  Performance  Software  Dev. 

Aviation 

Consulting 

Manufacturing  (PBX's) 

Mainframe  Software  Development 
Integrated  Chemical  Manufacturing 
Insurance 

Mainframe  Software  Development 


All  users  had  various  mainframe  systems  but  were  making 
extensive  use  of  PCJs  for  development. 


II.  Marketing  Profile 


Most  users  first  heard  of  ASAP  during  a trade 
conference  (such  as  AAAI).  Two  had  been  introduced  to 
Arthur  Anderson  and  one  by  their  IBM  Marketing  Rep.. 


Show  or 
it  by 


The  most  important  motivation  for  purchasing  an  expe 
System  package  was  a desire  to  be  at  the  leading  edge  of  their 
iridustiv,  followed  by  a need  to  stay  competitive,  a perceived 
business  application,  and  a perceived  increase  in  profitability. 


KE1.,  ART,  SI,  GURU,  and  Person 
most  frequently  examined  alternatives 
Shell  except  SI  had  one  knowledge  base 


al  Consultant  Ptus  were  the 
to  ASAP.  Of  these,  each 
in  production  by  some  user 
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in  addition  to  ASAP. 


pcc<,n',der.,Ld,  ese  ani*  tw°  h*d  actua>iy 

ii.  incy  rated  PC  compatibility  as  the  most  important 


uesVrnda°ta  “IT"*  ^ ^ **■  *>V  easier  TcceVs  , 

'*”  °f  U!‘''  *"d  ‘«h»el«*ic.l  and  func.ion 


superiority, 


to 
a I 


III.  Performance/Satisfaction 

h ^ °nly  one.  user>  ^eing  Corp.,  did  not  have  an  ASAP  knowledge 

ASApm  P.r0dUct,on  or  c,0se  t0  production  (they  have  only  had  the 
ASAP  package  since  January).  The  rest  accounted  for  a total  of  8 
amframe  and  4 PC  knowledge  bases  in  limited  or  full  production 

exclededVh  ind,C3ted  ^ th°'r  ^ge  base  had  met  or 

exceeded  their  expectations  and  increased  user  productivity  Only 

one  user  felt  that  developing  the  knowledge  base  had  cost  them 
investment*1  ^ they  Were  n°l  Unhappy  their 

MSA  was  the  only  user  that  had  experienced  capacity  or 
performance  problems  on  the  mainframe.  Th,s  occurred  when  they 
tried  to  use  a substate  to  do  traditional  record  processing.  Each 

was"  reaThed  * tT ™ °f  ^ SUbstate  ,n  memory  until  capacity 
was  reached.  They  are  still  working  on  an  acceptable 

AHCnthe,lt,0n  f°r  th'S  bUt  arS  optimis,,c  that  one  will  be  found, 

A other  capacity  problems  reported  had  to  do  with  the  640  K DOS 

IXd'VTs/z  UserS  genGraUy  fek  thal  thls  proble-  wou,d  b* 

While  no  one  reported  that  their  knowledge  base  ran  too 

IcceWptableSeoerfal  U"SUre  Whethor  they  could  maintain 

acceptable  performance  once  they  expanded  their  systems  for  full 

tool  thT'  rMUr  AnderSOn  indicated  that  they  were  working  on  a 
tool  that  would  compile  ASAP  knowledge  bases  into  PL/I  and  allow 
applications  to  run  21  times  faster. 

All  users  were  satisfied  to  very  satisfied  with  ASAP  Corp 
company  to  do  business  with,  the  technical  expertise  of  ASAP 
personnel,  their  decision  to  purchase  ASAP,  the  ease  of  use  of 
the  package,  ASAP  Corp.'s  responsiveness  to  program  bugs  the 
completeness  of  ASAP  functions  and  soundness  of  code  performance 
of  their  knowledge  bases,  and  quality  of  ASAP  education. 

Several  users  were  dissatisfjed  with  the  documentation 

needCUf  ^ t0  th*  ma,nfra™e  version,  they  cited  a ’ 

" *d  f /"  ,ndex'  better  organ.zation,  and  more  in-depth 
6 certa,n  functions  such  as  accessing  external  data.  A 

Idur  UtSftrS  WS,re  alS°  d,ssatisf,ed  the  availability  of 

education  and  techn.cal  support  but  this  was  mostly  due  to 
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geography  and  time  zones. 


IV.  Features  & Functions 


ACApTi16*reSPOn  ntS  Were  aSked  t0  rate  the  *mP°rtance  of  various 
, fB3tures  which  are  not  available  (or  have  a different 
implementation)  in  ESE.  Rated  very  important  to  critical  were  (in 
order  of  importance): 


1. )  Ability  to  write  to  disk  files 

2. )  Record  processing 
3 ) List  processing 

4. )  Ability  to  define  "Types" 

5. )  Developing  applications  on  PC 

6 ) Application  development  by  multiple  developers 

7. )  Ability  to  incorporate  reports 

8. )  Set  processing 


Rated  important  to  very  important  were: 


9. )  Ability  to  run  under  IBM  CICS/VS 

10. )  Access  to  DL/1  databases  and  VSAM  files 

11. )  Ability  to  "Browse"  files  during  development 

12. )  Displaying  memory  used  by  knowledge  base  or  state 
13  ) Date  and  time  data  types  and  calculations 

14. )  SOL  support 

15. )  Ability  to  view  status  of  objects 

16. )  Executing  applications  on  different  processors 

17. )  Delivering  applications  on  PC 

18. )  DB2  command  support 

19  ) Ability  to  run  under  IBM  IMS/VS 

20  ) Ability  to  run  system  commands  during  development 
Rated  slightly  important  to  important  were: 


21. )  ASAP  Vocabulary"  feature 

22. )  Evaluating  the  "cost"  of  a rule  (parameters  fired) 

23. )  Ability  to  incorporate  graphs 
24  ) Password  security 

2S.)  Defining  "noise  words"  in  a vocabulary 


ti  N°.  ,feiatUres  wore  rated  not  important  to  slightly  important 
This  could  be  interpreted  to  mean  that  all  of  these  features  are 
being  used  to  some  extent  by  some  users. 


Questions 
tended  to  be 
product. 


relating  to 
rated  low 


specific  products  such  as  DB2  and  IMS 
by  respondents  who  were  not  using  the 


Displaying  the  memory  used  by  a knowledge 


base  was  rated 
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high  because  of  the  640  K DOS  limit  on  the  PC.  Users  did  not  feel 
this  was  as  important  when  developing  mainframe  applications. 

The  ability  to  incorporate  graphs  was  rated  low  because  most 
users  did  not  like  the  ASAP  implementation.  Most  would  prefer  to 
have  some  kind  of  vector  or  raster  graphics  capability. 

The  most  frequently  requested  enhancements  were  the  addition 
of  frames  with  inheritance,  a better  screen  design  tool,  more 
procedural  processing  capability,  removal  of  the  PC  640  K DOS 
arner,  performance  improvements,  an  interface  to  STORYBOARD  or 
o er  graphics  packages,  and  better  documentation. 
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APPLICATIONS 


Boole  t Babbacs 

DftSD  Analysis  Package 

■ Still  under  developient 

- Runs  on  lainfraie 

- 10  KB's  strung  together  ( 2MB  ) 

- Sa»e  rules  go  tor  3 pages 

MVS  Perforiance  Analysis 

- Runs  on  *ainfraie 

- satisfactory  perforiance 

Capacity  Planning 


i 

Boeing 

No  productive  applications  at  present.  Have  had  ASAP  only 
Since  January. 


Arthur  Anderson 


Risk  Assessient 

- Analyzes  risk  of  doing  business  with  a client 

- Runs  on  PC 

* Fills  PC  capacity 

~ Exceeded  expectations 

- Easily  accepted  by  users 

* Realized  quality  (vs  productivity)  uprovesents 

Mortgage  Loan  Advisor 

- Runs  on  PC  or  lainfraae 

- Sold  to  custoeers  i/bundled  ASAP 

- Custoaized  to  users 

- Satisfactory  perforiance 

Cheiical  Foriulary 

“ User  describes  compound  and  systea  generates  chenca! 
foriula 

Deposit  Products  Advisor 

Advises  users  on  ihat  type  of  deposit  vehicle  to  use 
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Northern  Telerca 

Engineering  Change  Management  Prototyping 

- Runs  on  mainframe 

- Mould  run  on  PS/2  4 OS/2 

- Part  of  a larger  traditional  application 

- Multiple  users  input  in  multiple  sessions 
Accepts  change  requests  and  problem  reports 

■ Generates  reports 

- Allows  online  queries 

- Does  document  processing 
~ Sends  messages 

“ Contains  about  100  screens 

- Phase  1 complete  by  Oct.  ’87 

- Expect  10  VH  sites  by  Oct,  ’88 
* Potential  47  sites 


HcCoraact  t Dodoe 
Shipping  Advisor 


- Runs  on  PC  or  mainframe 

- Analyzes  where  carrier  service  areas  are  and  their 

reliability 

* Advises  on  best  carrier  to  use 

- Useful  in  contract  negotiations 

- Saves  ainnua  of  iB.OQ/shipment  ($800.Q0/dayl 

- Plan  to  expand  to  other  locations 

Software  Implementation  Advisor 

* Under  development 

Customizes  financial  software  to  user  needs 

- 500  to  1000  objects 


Rohm  & Haas 


Product  Useaqe  Diagnostics 

- Used  by  support  personel  to  advise  on  product  useage 

- Runs  on  mainframe  due  to  distribution  4 security 

concerns 

- Developed  on  PC 
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Provident 

Bond  Selection  Advisor 

- Ranks  bond  yields  for  retireaent  investients 

- Runs  on  aainfraae 


MSA 


W2  For*  Advisor 

* Advises  on  hon  to  fill  out  W2 

- Runs  on  PC 

- Perejeved  aonetary  saving 

- Coded  by  doaain  expert 

Manufacturing  Application  Installation  Advisor 

■ About  to  be  announced 

- Runs  on  aainfraae 

- 2000  objects 

- Good  perforaance 
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ASAP  Usrw  S^pyry 

Trip  Report 


Boole  8 Babbage 


Boole  & Babbage  is  a software  development  company  which 
primarily  produces  performance  monitors  for  mainframe  systems. 
Their  Senior  Vice  President,  Jack  Van  Kinsbergen,  left  IBM  in 
1967  and  has  known  Harry  Reinstein  and  Larry  Cohn  for 
approximately  20  years.  He  was  instrumental  in  putting  them  in 
touch  with  venture  capitol  firms  and  once  sat  on  the  ASAP  Corp. 
Board  of  Directors  when  it  was  first  formed  Consequently,  he  was 
granted  special  pricing  arrangements  to  use  ASAP  before  it  was 
even  developed.  He  says  he  saw  a use  for  expert  systems  in 
systems  management  and  viewed  them  as  an  integral  part  of  the 
next  generation  of  Boole  & Babbage  products. 

He  indicated  that  one  of  the  primary  reasons  they  would  not 
consider  ESE,  apart  from  any  personal  relationships,  was  that 
they  needed  intensive  data  analysis  and  that  there  was  no  way  to 
do  this  with  ESE.  Their  requirements  were  for  data  access  and 
number  crunching  versus  dialogue  management.  ESE  was  never 
seriously  considered  as  a solution. 

Their  primary  ASAP  application  is  a DASD  analysis  package 
that  runs  on  a 4381.  Although  it  is  still  under  development,  it 
has  been  demonstrated  to  potential  customers  and  has  received  an 
enthusiastic  response.  The  application  consists  of  ten  knowledge 
bases  strung  together  like  programs  in  a procedure.  Although  he 
would  not  guess  at  the  number  of  rules,  parameters,  or  objects  he 
estimated  that  the  application  consumed  about  two  million  bytes 
of  storage. 

He  didn't  feel  there  were  any  physical  limits  on  the  size  of 
an  ASAP  knowledge  base  but  performance  and  hardware  limitations 
would  demand  that  large  applications  be  divided  into  several 
smaller  KB’s  as  in  conventional  programming.  He  indicated  that 
the  amount  of  main  storage  required  exploded  with  the  amount  of 
data  processed.  He  didn't  feel  this  was  a problem  as  much  as  a 
design  consideration  for  states.  He  felt  that  to  some  extent  they 
had  misused  ASAP  to  do  inferencing  on  number  crunching 
applications  and  that  some  states  should  be  redesigned  to  utilize 
PASCAL  or  COBOL  routines  for  heavy  numeric  processing.  The 
applications  they  were  working  on  were  described  as  "current 
time"  as  opposed  to  real  time  products.  In  other  words,  the  user 
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analyzes  data  that  may  have  been  collected  over  several 
days  to  see  what  happened  on  the  system. 


hours  or 


Currently,  their  emphasis  is  on  mainframe  solutions,  however 
he  sees  the  PC  as  an  important  addition.  They  needed  the 
mainframe  for  power  and  because  they  had  to  access  a lot  of 
online  data.  He  felt  the  PS/2  and  OS/2  solved  this  problem.  They 
need  a compatible  inference  engine  between  the  PC  and  mainframes 
and  would  like  to  develop  and  execute  applications  either  way. 

Jack  views  expert  systems  as  a next  generation  procedural 
programming  tool  which  will  allow  B & B to  write  applications 
more  easily  and  productively.  He  says  that  an  expert  system  is 
equivalent  to  an  operating  system  and  "over  time  it  will  be  the 
way  to  write  programs”. 


Boeing  Corporation 


Boeing  Computer  Services'  Bellview  research  center  is 
responsible  for  developing  new  business  opportunities  for  AI 
within  Boeing.  George  Brown,  their  AI  Sales  & Marketing  Manager 
explained  that  his  department  evaluates  AI  software  and  hardware, 
provides  planning  assistance  and  tries  to  transfer  technology  to 
the  user  computer  departments.  He  considered  this  hard  to  do  with 
ART,  KEE,  and  other  advanced  shells  and  they  were  moving  slow  on 
these  but  moving  ahead  on  rule  based  systems.  Although  he  had 
only  been  in  this  job  for  six  months,  George  felt  that  AI  was 
stagnating.  "The  research  people  think  AI  is  wonderful  but  the 
application  developers  think  it  stinks.  There's  lots  of  hype  but 
it  hasn't  produced." 


He  thinks  that  the  momentum  is  moving  towards  rule  based 
systems  because  they’re  easier  to  use,  easier  to  train 
accessible  on  PC's  or  mainframes,  have  little  front  end  expense, 
and  can  leverage  the  existing  hardware  base.  Harry  Reinstein  gave 
a presentation  several  weeks  ago  to  Boeing  personnel.  They  have 
only  had  the  ASAP  package  for  about  six  month  and  are  just 
starting  to  get  people  exposed  to  ,t.  They  are  planning  to  use  it 
to  generate  COBOL  code  and  applications  but  now  they  are  simply 

coding  stand  alone  expert  systems  or  integrating  it  with 
traditional  code. 

He  indicated  they  have  a need  to  interface  to  DB2  and  would 
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like  to  imbed  SQL  statements.  ESE  was  rejected  because  of  IBM’s 
apparent  lack  of  interest  in  providing  this  interface.  Other 
reasons  cited  were  PC  compatibility,  a better  development  and 
delivery  environment,  and  easier  access  to  user  data.  He  also 
noted  that  ASAP  "states"  were  similar  to  frames  and  that  this  was 
one  indication  of  the  technological  superiority  of  the  ASAP  Corp. 
package. 

Boeing  has  also  examined  several  other  expert  system  shells 
including  REE,  ART,  Knowledge  Craft,  GURU,  TWAICE,  Expertease, 
Nexpert,  SI,  OPS/S,  PC  Plus,  and  Rulemaster,  however,  this 
department  had  only  had  experience  with  Personal  Consultant  Plus 
and  ASAP.  Generally  they  are  very  happy  doing  business  with  ASAP 
Corp.  They  projected  an  image  of  being  former  IBM’rs  who  could  be 
counted  on  According  to  George,  "It’s  like  doing  business  with 
IBM". 


Arthur  Anderson 


Bruce  Johnson,  Partner  in  Charge  of  AI  Practices  and 
Director  of  Research,  met  Harry  Reinstein  before  ASAP  was  really 
a product.  They  negotiated  a fixed  price  contract  for  unlimited 
use  of  the  programs.  Consequently,  they  use  ASAP  as  a 
productivity  aid  and  to  develop  internal  applications..  They  have 
developed  a Risk  Assessment  package  for  use  by  their  field  reps, 
ftp; well  as  several  knowledge  :bas*v  that  are  bundled  with  ASAP  and 
•old  to  their  customers,  including,  a Mortgage  Loan  Analysis 
Package  (which  runs  on  both  PC  and  mainframe  and  can  be 
customized  to  individual  users),  a Chemical  Formularies  package 
(which  calculates  the  chemical  formulas  of  various  compounds 
described  to  it),  and  a Deposit  Products  Advisor  (which  gives 
advice  on  what  type  of  deposit  vehicle  to  use).  They  also  build 
expert  systems  for  clients  on  contract.  According  to  Bruce,  ASAP 
is  likely  to  win  half  of  these  competitive  bids  because  the 
client  can  seef  a prototype  without  buying  a license  and  it  ports 
from  PC  to  mainframe.  He  did  cite  one  example,  however,  of  a 
customer  who  walked  away  from  an  application  because  ESE  couldn’t 
do  the  job  (even  though  ASAP  could)  and  he  did  not  want  a non-IBM 
solution. 
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In  addition  to  ASAP,  Arthur  Anderson  also  has  several  other 
expert  system  packages  including  KEE,  ART,  SI,  NEXPERT,  Personal 
Consultant  Plus,  Ml,  GURU,  EXCEL,  and  SAGE.  Only  GURU  and 
Personal  Consultant  Plus  have  been  used  to  actually  develop 
applications  (Guru  because  of  access  to  a relational  database, 
and  Personal  Consultant  Plus  because  there  was  a requirement  to 
run  on  DEC).  ASAP  was  chosen  over  ESE  primarily  because  of  PC 
compatibility,  ease  of  use,  availability  on  various  operating 
systems,  and  the  fact  that  it  could  be  integrated  (imbedded)in 
other  applications.  Bruce  also  noted  that  ASAP  outperformed  ESE 
by  about  3 to  1 and  that  they  were  working  on  a tool  that  would 
compile  ASAP  into  PL/1  code  and  increase  performance  by  a factor 
of  21. 


Internally  they  use  the  PC  version  of  ASAP  for  both 
development  and  delivery  since  their  offices  don't  have  access  to 
a mainframe.  Arthur  Anderson  Consultants  use  customer  systems  and 
upload  from  a PC  when  necessary.  Customer  applications  are  either 
PC  or  mainframe  depending  on  the  project.  If  the  user  has  to 
operate  in  the  field,  they  use  the  PC.  Their  philosophy  is,  don’t 
use  a mainframe  unless  you  have  to.  According  to  Bruce,  the  only 
time  they  are  allowed  to  use  a mainframe  is: 

a. )  There  is  a centralized  database 

b. )  The  knowledge  base  is  frequently  changing  (e.g.  the  data 

base  has  to  be  updated  frequently). 

c. )  The  knowledge  base  has  to  run  on  an  existing  network 

with  no  terminals. 

d. )  You  are  building  part  of  an  application  that  needs  to  be 

centralized. 

e. )  Capacity  limitations. 

Although  he  was  very  satisfied  with  ASAP,  he  did  acknowledge 
that  there  was  room  for  improvements.  He  thinks  the  dialogue  is 
sometimes  long  and  drawn  out  causing  a bit  of  thrashing  (e  g.  the 
re-do  function  causes  re-answering  of  all  questions  from  that 
point.  This  could  be  solved  by  using  truth  maintenance).  He  also 
indicated  that  they  often  bumped  against  the  640k  DOS  limit  on 
the  PC  but  expected  this  would  be  somewhat  alleviated  by  the  PS/2 
and  OS/2.  Several  other  employees  also  described  a need  for  a 
procedural  type  language  to  allow  more  flexibility  in  the  flow  of 
logic,  performance  improvements,  and  user  defined  indexing  in 
arrays  (as  in  PASCAL)  as  additional  requirements.  On  the  other 
hand,  ASAP  was  described  as  very  easy  to  learn  and  faster  to  use 
than  traditional  code.  It  was  noted  that  a new  programmer  could 
learn  to  be  productive  in  3 to  4 days  and  that  they  were  able  to 
code  one  application  10  to  15  times  faster  using  ASAP  than 
conventional  programming 
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Northern  Telecom 


Northern  Telecom  is  a manufacturer  of  PBX  switching  systems. 
According  to  Joe  Sura,  Manager  of  their  CAM  Program,  their 
primary  expert  system  application  is  in  the  area  of  Engineering 
Change  Management  prototyping.  They  have  built  a system  using  a 
mixture  of  ASAP  and  conventional  code  which  requests  engineering 
changes,  generates  relevant  reports,  reports  problems,  does 
online  queries,  document  processing,  and  sends  messages  during 
multiple  sessions  with  several  users  providing  input  to  the  same 
process. 

They  first  got  approval  to  build  a prototype  and,  having 
successfully  completed  that  stage,  are  now  funded  to  build  a 
corporate  production  system.  The  prototype  is  now  in  use  at 
several  locations  They  expect  to  have  a Phase  I production 
system  ready  by  this  October  and  hope  to  have  10  VM  sites  running 
by  October  1988.  Eventually,  they  would  like  to  have  the  system 
up  in  all  47  of  their  plants. 

In  their  search  for  an  expert  system  package,  they  examined 
KEE,  ART,  EXCON,  and  SI,  as  well  as  ASAP  and  ESE.  They  have  built 
knowledge  bases  in  both  KEE  ind  ART  and  did  not  use  ASAP 
primarily  because  there  was  a requirement  for  these  applications 
to^  run  on  UNIX  workstations.  They  briefly  considered  ESE,  but  it 
was  rejected  primarily  because  it  lacked  PC  compatibility.  It  was 
also  felt  that  ASAP  had  more  function  and  was  technologically 
superior  He  gave  me  a copy  of  their  analysis  which  I have 
included  in  my  report  (see  "ECM  Prototype  Project  Overview" 
attached).  Joe  also  noted  that  the  IBM  programming  teams  never 
really  seemed  to  grasp  what  they  were  trying  to  do  and  the  lack 
of  coordination  between  the  different  IBM  groups  was  evident. 

Although  overall,  he  was  satisfied  with  ASAP,  Joe  did 
mention  several  areas  for  improvement.  They  did  not  like  the  way 
ASAP  handled  screen  design.  There  were  several  inconsistencies 
between  the  PC  and  mainframe  versions  in  the  way  they  handled 
screens  (e.g.  the  VM  version  does  not  allow  data  or  literals  past 
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column  78  while  the  PC  version  does  - this  is  not  well 
documented)  and  it  was  difficult  to  get  ASAP  to  display  fixed 
format  screens.  He  would  like  to  see  a fourth  generation  language 
screen  painter  incorporated  in  the  package.  They  are  also 
building  their  own  generic  SQL/DS  interface.  Their  routine 
listens  for  ASAP  to  request  data,  calls  SQL,  and  returns  the 
information  to  ASAP.  They  would  like  something  like  this  to  be 
integrated  with  the  expert  system. 

Other  suggestions  included  the  ability  to  format  date  and 
time  values,  a library  of  independent  routines  that  could  be 
called  from  anywhere  in  the  knowledge  base  rather  than  recreated 
in  each  branch  or  state,  the  ability  to  define  PF  keys,  control 
output  to  line  23  and  24  of  the  screen,  and  define  underlines  as 
value  holders  on  a screen  rather  than  boxes  or  blanks  so  that  the 
screen  looks  more  like  a form. 

They  would  prefer  to  do  more  work  on  the  PC  version.  The 
main  reason  they  haven’t  is  because  of  the  640K  DOS  limit  but 
they  expect  this  will  change  with  the  PS/2  and  OS/2.  According  to 
Joe,  it  is  "outstanding"  and  "much  nicer".  They  are  "highly 
satisfied  with  it"  and  "you  can  do  some  nice  things  on  the  PC 
that  you  can't  do  on  VM". 


McCormack  & Dodge 


McCormack  & Dodge  develops  accounting,  financial,  database, 
and  language  software  for  mainframe  systems.  They  first  heard 
about  ASAP  from  Arthur  Anderson.  In  their  search  for  an  expert 
system  they  also  examined  ART,  KEE,  SI,  KES,  and  Personal 
Consultant  Plus  in  addition  to  ESE.  None  of  these  was  ever 
installed.  John  Birch,  their  Corporate  VP  and  a former  IBM 
employee,  summed  up  their  reasons  for  choosing  ASAP; 

"A  number  of  expert  systems  had  their  base  in  academia  with 
people  with  Phd's  in  computer  science.  ASAP  was  overwhelmingly 
better  in  useability.  Many  start  up  companies  don’t  have  any  idea 
what  users  really  want  to  do.  Other  companies  said  they  planned 
to  run  on  IBM  hardware.  ASAP  already  did.  No  other  vendor  could 
deliver  their  product  with  the  same  speed  and  integrity. 
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ESE  is  technologically  2 to  3 years  behind  ASAP.  We  weren't 
willing  to  wait.  ESE  has  a lot  of  catch  up  to  do.  Some  people 
would  buy  a garbage  can  with  lights  if  it  was  painted  blue  and 
had  IBM  on  it.  Why  not  just  go  along  with  them  (ASAP  Corp.).  It 
(ASAP)  was  better  a year  ago  and  it's  still  better  and  they  keep 
improving." 

John  cited  several  reasons  for  claiming  that  ASAP  was  a 
superior  product  including  the  user  interface,  portability  across 
operating  environments,  debugging  features,  CICS  and  LU6.2 
support,  states  and  sub-states,  application  development  by 
multiple  developers,  file  access,  and  PC  compatibility. 

He  said  that  they  would  not  buy  a product  that  did  not  run 
on  a PC.  They  would  even  settle  for  less  function  as  long  as  it 
satisfied  their  needs.  Distributed  processing  is  very  important 
to  them.  They  would  like  to  develop  on  mainframes  and  deliver  on 
PL  s.  That  allows  them  "not  to  lockstep  expert  system 
applications  with  PC  applications".  For  example,  information  for 
a financial  application  could  be  entered  on  a PC  and  batched  to  a 
mainframe.  A PC  can  be  brought  in  at  a low  investment  to 
prototype  an  application  and  test  the  product. 

They  currently  have  one  prototype  in  limited  use  internally 
and  another  under  development.  The  former  is  a shipping  advisor 
which  gives  information  on  the  reliability  of  a carrier,  where 
their  service  areas  are,  and  the  best  carrier  to  use  for  a given 
shipment.  The  system  reduces  claims  against  carriers,  helps  in 
contract  negotiations,  and  allows  users  in  other  departments  to 
use  a variety  of  shipping  methods.  They  estimate  that  it  saves 
them  a minimum  of  S800.00  per  day  at  their  test  facility  and  they 
plan  on  expanding  it  to  the  other  locations  shortly. 

They  are  also  in  the  process  of  developing  a software 
installation/implementation  tool  which  will  allow  their  customers 
to  customize  their  financial  software  to  their  own  requirements. 

John  noted  that  ASAP  Corp.  was  very  supportive  concerning 
enhancement  requests  For  example  they  told  him  they  would  add 
frames  if  he  felt  it  was  necessary.  He  would  like  to  have  this 
implemented  as  well  as  national  language  support,  and  a PC 
interface  to  STORYBOARD  or  other  graphics  packages  that  would 
allow  display  of  maps  and  slides  during  a consultation.  He  would 
also  like  to  see  local  support  expanded  outside  the  U.S.  since 
they  have  several  overseas  centers. 


His  only  complaint  was  with  the  documentation,  which  he  said 
needed  better  organization,  an  index,  and  could  be  made  more 
readable.  . /■  ■ 
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substandard  developers  interface  and  that  ASAP  was  a superior 
product  in  the  areas  of  ease  of  use,  PC  compatibility, 
architecture,  and  functions  such  as  CICS  and  LU6.2  compatibility, 
list  processing,  and  type  definition.  They  also  felt  that  they 
would  not  be  able  to  get  close  cooperation  from  IBM  on 
enhancement  requests  and  were  not  comfortable  with  the  fact  that 
ESE  was  only  a program  offering. 

Ed  was  very  pleased  to  do  business  with  ASAP  Corp..  "It's  no 
exaggeration  that  they  are  the  best  software  company  that  I’ve 
ever  had  to  deal  with."  Nevertheless,  he  did  list  a number  of 
enhancements  he  would  like  to  see  incorporated,  namely; 

a. )  Easier  access  to  both  IDMS  and  FOCUS  files. 

b. )  Removal  of  640K  DOS  barrier  on  PC  and/or  implementation 

of  virtual  memory  for  ASAP. 

c. )  Callable  subroutines  or  states 

d. )  Ability  to  set  up  a matrix  or  lookup  table  and  allow 

screen  entry  of  such  a matrix  (as  in  spreadsheets). 

e. )  Formlike  entry  screens. 

f. )  Frames  with  multiple  non-hierarchical  inheritance 

(substates  which  could  receive  values  from  superstates 
and  callable  routines  would  address  this  to  some 
degree. 

E-)  Truth  maintenance 

h. )  Better  message  passing  ability  and  ability  to  put  Text 

Substitution  Language  (TSL)  statements  in  variables. 

i. )  Forward  Chaining 

j. )  Better  graphics  interface  (CAD/CAM  vector  type). 

k ) Ability  to  generate  pseudo  english  explanations  during 
consultations. 


- 


Provident 


Provident  Insurance  Company  had  ESE  installed  but  switched 
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to  ASAP,  The  primary  reasons  cited  were  easier  access  to  user 
data,  integration  and  compatibility  with  traditional  DP 
applications,  and  PC  compatibility,  According  to  Mike  Harter, 
their  Project  Director  for  New  Technology,  "ESE  can  build  stand 
alone  (MYCIN  type)  knowledge  bases.  ASAP  has  more  DP  control  and 
can  get  at  DB2  through  COBOL.  It  runs  in  all  environments  and  has 
easy  access  to  data.  It's  a step  towards  AI  that  doesn't  divorce 
itself  from  DP.”  They  would  pick  a package  that  ran  on  both  the 
PC  and  mainframes  over  one  which  ran  on  the  PC  alone  unless  there 
were  features  of  the  mainframe  only  system  that  were  absolutely 
needed.  "The  internal  billing  for  mainframe  usage  was  too  high" 
when  they  were  using  ESE.  Consequently,  when  it  is  equally 
feasible  to  do  development  on  the  PC  or  mainframe,  they  will  do 
it  on  the  PC  because  of  the  cost  involved. 

ESE  was  the  only  expert  system  seriously  considered  because 
they  had  a requirement  to  deliver  their  applications  on  MVS. 
Nevertheless,  development  was  split  between  the  PC  and  mainframe 
with  the  mainframe  used  only  when  necessary  to  test  external 
calls.  They  currently  have  a Bond  Availability  Advisor  in 
production  which  ranks  bond  yields  for  retirement  investments  and 
is  run  about  once  a week.  They  are  also  looking  at  developing  a 
Risk  Assessment  System  for  underwriting. 

While  overall  they  are  very  happy  with  ASAP,  they  suggested 
the  following  enhancements; 

a. )  An  improved  screen  editor.  Currently  message  screens  and 

input  screens  use  different  editors.  Also,  the  user  can 
not  see  what  the  output  will  look  like  until  the  screen 
is  put  into  the  knowledge  base  and  you  have  to  create 
your  own  data  types  (e.g.  character,  integer,  etc.)  for 
customized  screens.  They  liked  the  way  ESE  handled 
screen  design  better  than  ASAP. 

b. )  Better  documentation.  They  indicated  that  there  was  not 

enough  detail  in  areas  where  you  need  detail  (e.g.  how 
to  call  external  routines. 

c. )  Some  error  messages  need  better  handling  and 

explanation, 

d. )  They  would  like  to  incorporate  nested  IF's. 

e. )  Improved  file  read/write  access.  They  do  not  do  dynamic 

links,  and  this  makes  external  interfaces  more 
difficult. 

f. )  Consistent  math  between  mainframe  and  PC.  The  two  don't 

always  give  consistent  results  because  of  double 
precision  on  the  PC.  They  indicated  ASAP  Corp.  had 
committed  to  fix  this. 

g. )  Generic  object  operations.  Currently,  for  example,  you 

have  to  know  which  state  a parameter  belongs  to  in 
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order  to  copy  it. 

h_)  Ability  to  define  multiple  record  types  in  a file. 

* > °Ptlon  to  use  SCRIPT  instead  of  Text  Substitution 
Language.  Why  should  user  have  to  learn  both. 

j. )  Reports  and  messages  could  be  smarter. 

k. )  Ability  to  mask  output  fields. 

l. )  Ability  to  place  multiple  "OR"  constraints  on 

parameters. 

m. )  Frames  with  inheritance. 


MSA  Corp. 


Mark  Scofield,  Expert  Systems  Manager,  describes  MSA  as  a 
Research  and  Development  and  Corporate  Advisor.  Primarily  they 
develop  financial  and  accounting  software  for  mainframe  systems. 
Mark  doesn't  consider  the  PC  as  critical  for  their  needs  but 
nevertheless,  they  do  most  of  their  development  on  the  PC  because 
of  productivity,  graphics,  and  ease  of  use.  They  also  set  billed 
internally  for  mainframe  time  and  find  the  PC  cost  effective. 

They  currently  have  a knowledge  base  that  advises  on  WZ 
forms,  and  are  about  to  announce  a Manufacturing  Application 
Installation  Advisor. 

They  considered  ESE  but  felt  that  ASAP  offered  easier  access 
to  their  data.  They  also  felt  uncomfortable  with  ESE  after  ASAP 
Corp.  supplied  them  with  performance  specifications  and  IBM  could 
not. 


Mark  listed  several  enhancements  he’d  like  to  see 
incorporated; 

a. )  A better  "HELP"  facility. 

b. )  Frames  with  inheritance  and  more  object  orientation. 

c. )  Ability  to  do  modeling 

d. )  Integrated  CAD/CAM  type  vector  graphics 

e. )  An  easier  way  to  handle  certainty. 

f. )  Better  provisions  for  multi-record  processing. 

Currently,  this  requires  that  subatates  be  called 
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multiple  times  by  a main  state  and  this 
of  memory  and  is  inefficient. 


eats  up  a lot 
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Input  Corp. 

1280  Villa  St. 

Mountain  View,  CA,  94041-1194 
Attn:  Mr.  Denny  White 

Subj:  Draft  questions  -for  IBM  Expert  System  survey 
Denny, 


Attached  you  will  -find  our  suggestions  -for  questions  to  be 
used  in  the  subject  survey.  We  decided  to  use  the  ADS  survey  of 
June  1987  which  I told  you  about  as  a base.  The  first  part  can  be 
used  pretty  much  as  is  if  you  eliminate  references  to  AI0N/ADS 
and  say  something  generic  (e.g.  "your  expert  system").  I've 
marked  up  some  minor  changes  and  you'll  find  some  additional 
questions  attached  which  you  can  work  in  where  appropriate.  I'm 
also  including  a list  of  features  and  functions  which  should  be 
added  to  the  features  and  functions  on  the  last  page. 

We  realize  that  this  is  a "wish  list"  and  is  subject  to 
negotiation.  Since  the  original  was  designed  for  "in  person" 
interviews,  you  may  also  find  it  necessary  to  reword  some 
questions  for  a phone  survey  and  eliminate  some  redundancy. 

I apologize  for  the  sloppy  nature  of  come  of  the  material 
but  because  of  the  time  constraints,  I felt  it  would  take  too 
long  to  re-type  and  clean  it  up.  Let  me  know  if  you  have  any 
questions  or  problems.  See  you  Wednesday  at  5:30. 


Les  Mezei 

IBM  Knowledge  Based  Systems 
2800  Sand  Hill  Rd. 

Menlo  Park,  CA.  94025 
(415)  858-6039 
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Mainframe:. . MVS/VM  etc. 

Workstations  (Non-PC): 


PC 


ADS  is  used  for 


IBM 

_____  PC's 

XT's 

AT's 

.. RT’s 

____  386 

production  on: 


Clones 

DOS/UNIX  etc. 


Type  of  System:  System  Software, 

Mainframe: MVS/VM  etc. 

Workstations  (Non-PC): 
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PC 


IBM 


Clones 

PC's  _____ 

XT's  

AT's  _____ 
RT's  ~ 

386 


DOS/UNIX 


etc. 


What  version  of  ADS  are  you  using  for:  Development 

Production 


II.  Marketing  Profile 


t 

t 

f 

t 


1.  What  was  this  company's  motivation  for  purchasing  an  Expert 
System  package  (rate  in  order  of  importance  - 0 = 
important,  l = slightly  important,  2 
important,  4 — critical  for  business)? 


important,  3 — very 


not 


t Z A.  O 


* / 

& 

B. 

£_ 

/ 

/ V 

z 

C. 

3 

3t 

Z * 

1 

D. 

L 

3 V 

it 

E. 

1 c 

y y 

it 

F. 

3_ 

z t 

/ 

G 

2 

_JL 

S 

3 

H. 

J 

2 

V 3 

l 

I. 

yj 

z. 

J. 

0_ 

.i 

Pressure  from  DP  staff 
Pressure  from  User  Departments 


Clearly  defined  business  application 


o w*  jmui  iiiuusir 

Desire  to  train  DP  staff  on  new  technology 


Y 

3 

u.s 

/ 7 

It 

tl 


Perceived  increase  in  programmer  productivity  17 
Perceived  increase  in  user  productivity  /*✓ 

K.  Other;  7 


2.  Where  did  you  first  hear  about  ADS?  (check  one) 


/ 


/// 

// 

// 

3. 


A. 

B. 

C. 
D 

E. 

F. 

G. 

H. 


AION  Marketing  Rep 

IBM  Marketing  Rep 

Other  Marketing  Rep 

Newspaper  or  Magazine  article 

Advertisement 

Trade  Show  frAQX 

Friend  or  Competitor  /} 

Industry  or  DP  conference/workshop 


— ■ J — — - 

Did  you  examine  any  other  Expert  System  software  (Y/N 


If  "Yes 
1. 

please  list; 

T°P±  kes  / 

fikr  /;/ 

K£-  £ //// 

2. 

3. 

/frAJbyJA£A*c/tAfT 

CpUkU  // 

'fW  A /c£- 

4. 

i/exfetri  JVUt 

kc  kcaS  // 

t 


B. 


V/3  Ex/**r 

S1Z 

1 \p'/)  I A-£ 

£,y/)£*r£*s* 

A 

Cfit/S  c 

^lE//***** 


0 9 o / 

A 3 X tt 
3 ZL  3 3 


C 2-  i 3 


3 3 3t  3 

£>  <9  l 2- 

O C i 

/'ft? 

3 1/? 

±3/3 


List  any  E/S  shells  that 
location  and  whether 
knowledge  bases: 


were  installed/tested  at  your 
they  are  now  running  productive 


1. 

2. 

3. 


JL 


4.  (Y/N)  / 

5.  (Y/N)  / 
6-  (Y/N)  / 


fe#se*i4<  c l t^sjt  //.us  // 

/ ~ ' — x — — - 

/ 

If  any  knowledge  bases  are  in  productive  use,  why 
wasn't  ADS  used  for  these  applications? 


Was 


IBM's  Expert  System  Environment  (ESE); 

, est  I AT  * 

1.  Considered I (Y/N)  // 

Installed I (y/N)  ff 


2 


0 

3 


o 

3 

If  / 


3.  Why  was  ADS  choisn  over  IBM/ESE^trata  in  order  of 
importance  - 0 = not  important,  1 = slightly 
important,  2 = important,  3 =;  very  important  )? 


£ 

0 
0 

6 A 
1 S 
0 J. 


3 


/ 

9> 


3 3 Z 


a. ) 

b. ) 

c. ) 


d.) 


e. ) 

f. ) 

g ) 

h. ) 

i. ) 

j. ) 


Cost 


Ease  of  Use 

Technological  Superiority 

Explain  


More  Function 
Explain 


PC  compatibility 
Soundness  of  code 
Installed  references 
Existing  industry  applications 
Easier  access  to  user  data 
Availability  on  Operating  System 


z 

/*.£ 

/ c • $ 


70.* 

7 

? 

v 

/7 

JS 


k.)  Other... 


4.  From  whom  did  you  purchase  ADS? 


III.  Performance/Satisfaction 

1 Do  you  have  *n  ADS  knowledge  base  in  productive  use  (Y/N)?  ^ f 

A.  Briefly  describe  its  function: 
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B.  This  knowledge  base:  (check  all  that  apply) 

Is  still  under  development 
— Did  not  meet  our  expectations 
Met  our  expectations 

/. Exceeded  our  expectations 

— Runs  too  slowly 

y__ Is  meeting  resistance  from  users 

Was  easily  accepted  by  users 

///. Has  saved  us  money 

— Has  cost  us  more  than  it  saved 
ftt — ^as  saved  us  development  time 

L Could  have  been  coded  easier  in  ??? 

/ 4 //  Has  increased  user  productivity 


7 

1.) 

2.) 

5 3.) 

/ 

4.) 

5.) 

/ 

6.) 

$ 

?.) 

3 

8.) 

/ 

9.) 

S 

10.) 

/ 

11) 

y 

12.) 

C,  How  big  is  this  knowledge  base? 


1. 

2. 

3 


Number  of  objects 

Number  of  rules 

Runs  on  (PC  or  Mainframe) 

ft)  ' ^ 


foe  3 


D.  Do  you  have  more  than  one  knowledge  base  in  productive 
use  (Y/N)?  _____  / 


1.  If  "Yes",  describe:. 


E.  How  big  is  the  largest  knowledge  base  described  in  D? 

Number  of  objects 


1. 

2. 

3. 

4. 


Number  of  rules  _Js  . f*C  - / 

Runs  on  (PC  oF'Mainf  rame)  * * f)fz3  N 
Is  the  performance  satisfactory  (Y/N) 


2.  Have  you  ever  tried  to  code  a knowledge  base  in  ADS  that  ran 

too  slowly  or  exceeded  the  capacity  of  ADS  (Y/N)? £ jjft 

A,  Describe  the  situation: 


B.  Could  you  circumvent  the  problem  using  ADS  (Y/N)? 

C.  Describe  the  circumvention:  


Uf*  V |o  f* 
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P'To  7‘Ly!“LOVert"  ■*“,fact"‘n  *»  *h«  follow, „8  areas: 

satisfied  , 4- 


3 i 3 3 3 3 . A y 9 
3 2 2+  3 3 4 R 7 * as  a companY  to  do  business  with 

0 s 6 t 9 „ * «— 7 Techmcal  expertise  of  AION  personnel 


AS.f 
f a) 

w.  - P - a,  ^ U S tl) 

3 XjL+j  *■  Soundness  of  ADS  code  /£ 

* / ' * H /£  !!N!  resP°"*»v«n^s  to  program  bugs  in  ADS  /*f,S 

, ^ , n-  t—L  ADS  documentation  jg 

* i , * V — ^Performan«  of  ADS  knowledge  bases  A 

« ^ * J-  A — ^ Ease  of  use  of  ABS 


0 S 6 t 3 5 c 1 ecnnical  expertise  of  AION  personne 

0 f 0 2.  9 , + 7 — * Quality  of  education/training  on  ADS 

3 A _J  . ‘ ^ Availability  of  education/training  on  ADS 

3.  X 3 2 r o — ^ Availability  of  technical  support  on  ADS 

F-  <£■ — X Soundness  of  ADS  code 


* X 3 S K.  ± 
{ <*-3  L L.  J_ 
*2+33  M . l_ 

of  J 1 j n.  j. 


-2- Ease  of  use  of  AES 
_X  Completeness  of  ADS  functions 
-2  Your  decision  to  purchase  ADS 
_^_The  people  who  sold  you  ADS 


X* 

/9.S 

J.* 

'1 


O.  Additional  comments: 


4.  What  about  ADS  would  you  most  like  to  see  changed/How? 


5.  What  do  you  like  most  about  ADS?. 


-w 
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9 

z V 

y 

3 

2 X 

/ 

3 

3 3 

3 

Y 

3 Y 

Y 

y 

3 Y 

Y 

3 

1 V 

Y 

¥ 

y z 

V 

o 

X t 

J 

0 

2 J 

Y 

z 

Z 1 

$ 

3 

Y Y 

Y 

2- 

/ 3 

3 

0 

X 2 

X 

c> 

Z / 

y 

0 

/ t 

j 

0 

* / 

j 

0 

z-  y 

y 

6 

Y p 

y 

0 

V o 

3 

d> 

Y t 

3 

Z 2 

Y 

o 

S / 

Y 

0 

3 9 

Y 

S 

Y / 

S 

c> 

y / 

Y 

IV.  ADS  Features/Funrtion* 


1.  How  important  are  the  following  ADS  features  for  you  to  build 
effective  and  productive  knowledge  bases  (rate  in  order  of 
importance  - O = not  important,  i r slightly  important,  2 = 
important,  3 o very  important,  4 = critical)?  f 

C . 0) 


y 

/ 

Y 

Y 

9 

Y 

% 

0 

l 

y 

s 


A.  Y- 

B-  l_ 


_3_  Application  development  by  multipl^developers 
i_  Ability  to  incorporate  graphs 


C.  ¥ 2.  Ability  to  incorporate  reports 

D-  Y 3.  Record  processing 

X.  List  processing 
Set  processing 

G-  Y 1 Ability  to  define  "Types" 

B-  z (L  ADS  "Vocabulary"  feature 

L 2 3 Password  security 

J-  Y. X Ability  to  view  "status"  of  objects 

K ^ 3 Ability  to  write  to  disk  files  from  knowledge  base 

3 3 Ability  to  "Browse"  files  during  development 


Z Y ■ Z Ability  to  run  system  commands  during  development 
Y+  N-  JL^Z  Displaying  memory  used  by  knowledge  base  or  state 


/ 

0 

z 

z 

0 

X 

z 

$ 

1 

V 

3 


2, /.  Defining  "noise  words"  in  vocabulary 

2- — 7~  Evaluating  the  "cost"  of  a rule  (parameters  fired) 
~ — 2 Dat®  and  time  data  types  and  calculations 
— $ Ability  to  run  under  IBM  CICS/VS 
' — ? Ability  to  run  under  IBM  IMS/VS 


O. 

P. 

Q. 

R. 

S. 

T. 

U.  _ 

v-  JtL — 2 DB2  command  support 

W.  J_ 3 SQL  support 

X-  -3 — 3 Developing  applications  on  PC 
Y-  2L — Delivering  applications  on  PC 

3*4 


-5L — ¥ Access  to  DL/1  databases  and  VSAM  files 
¥. — 2 Executing  applications  on  different  processors 


'flpO 


// 

1C, 

^ t* 

2 » 
XS 
tZ 
// 

n 

26 

n 

a 

n.s 

* 

/ L 

n 

ft 

tY 

/t 

/(, 

/$ 

n 

xi 

/S 


2.  What  additional  features/functions  would  you  like  to  see 
incorporated  into  ADS? 
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Additional  Questions 


1.  (Which  product  are  they  using?) 

2.  How  long  have  you  had  the  product  (month  and  year  of 

purchase) ? 

3.  If  you  were  making  your  "buy"  decision  today,  would  you  still 

choose  this  product? 

a.  If  the  answer  is  "No"  which  product  would  you  rather  have 

and  why  (list  important  features)? 

b.  If  the  answer  is  "Yes",  are  there  still  features  of  other 

current  products  which  you  wish  you  had  and  what  are 
they? 

4.  Do  you  feel  this  product  is  "state  of  the  art"? 

a.  If  not,  name  a product  which  is. 

b.  What  features  do  you  consider  to  be  "state  of  the  art"? 

What  percent  of  involvement  was/is  required  from  each  of  the 
following  skill  levels  to  develop  your  appl i cati on (5) . 

„ Research Prototype  Production 

a.  Business  Professional: | ; 

b.  D.P.  Professional!  j _ « * ~ 

c.  A. I . Professional:  ! • * 


J 
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INPUT  Features  Questions 

f2itSr«%Sryou??^n  ” FeaturoR/Funct*ons  Question  1,  "How  important  are  the  following 

lot  2w?nr,;?t;?Sd„^uia  ”isd  lnciudg  "no,  appi,capi°''  »= 

1.  Conforms  to  jbm  SAA  common  User  Interface 

2.  Provide  access  to  IBM  SAA  coimon  Programming  Interfaces  (CPI) 

3.  Supply  functions  that  are  identified  as  an  IBM  KBS  SAA  CPI 
A.  Ability  to  imbed  HLL  in  the  RHS  and  LHs  of  rules 

5.  Ability  to  imbed  rules  in  HLL 

6.  Datatypes 

a.  Currency 

b.  Time 

c.  Date 

d.  Binary 

e.  Character 

f.  Decimal 

g.  Floating  point 

h.  Integer 

i.  User  defined 

7.  Data  structures 

a.  Factored 

b.  Network 

c.  Hierarchical 

d.  Frames 

e.  Mixed 

f.  "Standard  HLL" 

8.  Graphics-oriented  developer  interface 

9.  Connectivity  to  existing  terminal  facilities 

10.  Connectivity  to  existing  data  storage  facilities 

a.  DB2 

b.  IMS  DL/I 

C.  DBASE,  RBASE  or  other  PC  products 

d.  Lotus  or  other  spreadsheets 

e.  IDMS  or  other  MF  DBMS's 

f.  VSAM 

g.  System  data  files 
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INPUT  Features  Questions 


h.  Frames 

A 

11.  AI  Functions 

a*  A.... Truth  Maintenance  Systems 

b.  Neural  networks 

c.  semantic  networks 

d.  Forward  ops 

e.  Goal  directed  ops 

f.  Emycin  backward 

g.  Frames 

12.  Concurrent  use  of  common  KB  by  multiple  users 

13.  storage  consumption 

♦ Real 

♦ Virtual 

♦ DASD 

1A.  Performance 

a.  Workstation 

b.  Host 

♦ Transaction 

♦ Batch 

15.  Portability  of  application 

16.  Portability  of  system 

17.  Multiplatform  development 

18.  Multiplatform  delivery 

19.  Platforms 

a.  VM 

b.  MVS 

c.  UNIX 

d.  OS/2 

e.  DOS 

f.  OS/AOO 

20.  Application  planning  aids 

a.  Design  tools 

b.  Performance  prediction 

c.  Storage  utilization 

21.  Knowledge  acquisition  tools 

22.  Active  Images 

June  2,  1988  IBM  Confidential  2 
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♦ For  developer 

♦ For  end  user 

23.  Delivery  on 

a.  LAN 

b.  Mainframe  host 

c.  Stand  alone  workstation 

d.  Non-programmable  terminal 

24.  Development  on 

a.  LAN 

b.  Mainframe  h09t 

c.  Stand  alone  workstation 

d.  Non-programmable  terminal 

25.  Knowledge  base  recovery 

26.  Knowledge  base  reentrancy 

27.  Embeddability 

a.  Transaction  systems  - IMS/CICS 

b.  Batch  applications 
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COMPANY  PROFILE 


INTELLICORP  Thomas  P.  Ketifer,  President  ao4-and  CEO 

1975  El  Camino  Real  West  Public  Corporation,  OTC 

Mountain  View,  CA  94040-2216  Total  Employees:  175 

(415)  965-5500  Total  Revenue,  Fiscal  Year  End 

6/30/88:  $20,433,000 


The  Company  IntelliCorp  develops,  markets,  and  supports  software  products 

used  to  develop  artificial  intelligence  (Al)-based  systems  and 
provides  custom  systems  development,  contract  research,  and 
consulting  professional  services.  IntelliCorp's  leading  product,  the 
Knowledge  Engineering  Environment™  (KEER),  was  introduced 
in  1983,  and  was  the  first  commercial  AI  software  product. 

• IntelliCorp  was  founded  in  September  1980  as  Intelligenetics, 
Inc.  by  four  Stanford  University  scientists  to  develop  and 
market  software  based  on  AI  technology  for  genetic 
engineering  applications.  The  company  changed  its  name  in 
June  1984  to  reflect  a shift  to  general-purpose  AI  products  and 
formed  a separate  division  called  Intelligenetics,  Inc.  to  market 
its  genetic  engineering  software. 

• In  December  1983,  the  company  made  an  initial  public  offering 
of  1.6  million  shares  of  common  stock,  generating  net  proceeds 
of  $8.5  million.  In  December  1985,  the  company  sold  1.3 
million  shares  in  a second  offering.  In  January  1986,  the 
underwriters  sold  an  additional  277,500  shares  on  behalf  of 
IntelliCorp.  Total  net  proceeds  to  the  company  were 
approximately  $17.9  million. 

• In  May  1986,  IntelliCorp  entered  into  a joint  venture  with 
Amoco  Corporation  for  the  development  and  marketing  of  AI- 
based  software  products  for  molecular  biology. 

- As  part  of  the  formation  of  the  venture,  IntelliCorp  sold  a 
60%  interest  in  Intelligenetics  to  Amoco  for  $4  million.  The 
$3.2  million  pre-tax  gain  from  this  sale  was  recognized  in  the 
fourth  quarter  of  fiscal  1986.  Amoco  holds  an  option, 
exercisable  in  May  1991,  to  acquire  IntelliCorp's  remaining 
non-voting  interest  in  Intelligenetics. 

- Intelligenetics  contributed  revenue  $1.9  million  and  income 
from  operations  of  $219,000  to  IntelliCorp's  fiscal  1986 


December  1988 
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results.  IntelliCorp  now  accounts  for  its  investment  in 
Intelligenetics  under  the  cost  method. 

In  July  1987  IntelliCorp  announced  a realignment  of  the  company, 
designed  to  respond  more  effectively  to  the  needs  of  its  customer 
base,  to  improve  financial  performance,  and  to  refine  its  strategic 
focus  on  future  product  and  market  objectives.  The  company's 
strategies  were  redefined  as  follows: 

• To  expand  the  availability  of  its  software  products  for  a range  of 
standard  hardware  platforms,  with  integration  capabilities  to 
conventional  programming  languages  and  data  bases.  At  the 
end  of  fiscal  1987,  about  80%  of  product  sales  were  derived 
from  versions  of  the  company's  software  running  on  non- 
conventional  hardware  platforms  (LISP  machines).  Currently, 
approximately  80%  of  IntelliCorp's  software  sales  are  for 
standard  (Common  LISP)  hardware,  such  as  Sun  Microsystems 
and  IBM  RT  PC  workstations,  and  DEC  VAXstation 
computers. 

• To  initiate  a vertical  marketing  program  that  brings  the 
company's  products  closer  to  the  end  user. 

• To  seek  strategic  alliances  with  major  hardware  vendors. 

During  fiscal  1988,  IntelliCorp  entered  into 
marketing/development  alliances  with  IBM  and  Hewlett 
Packard. 

IntelliCorp's  fiscal  1988  revenue  reached  $20.43  million,  compared 
to  fiscal  1987  revenue  of  $20.35  million.  Net  losses  were  $1.5 
million,  compared  to  net  losses  of  nearly  $4  million  in  fiscal  1987. 
A five-year  financial  summary  follows: 
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FIVE-YEAR  FINANCIAL  SUMMARY 
($  thousands,  except  per  share  data) 


FISCAL  YEAR 

ITEM 

6/88 

6/87 

6/86 

6/85 

6/84 

Revenue 

• Percent  increase 

$20,433 

$20,352 

$18,597 

$8,685 

$2,076 

from  previous  year 

— 

9% 

114% 

318% 

255% 

Income  (loss)  before 
taxes 

$(1,474) 

($3,987) 

$5,206 

$(626) 

$(1 ,684) 

• Percent  increase 

(a) 

(decrease)  from 
previous  year 

63% 

(177%) 

932% 

63% 

(131%) 

Net  income  (loss) 

$(1,474) 

$(3,987) 

$4,906 

$(724) 

$(1 ,684) 

• Percent  increase 

(b) 

(decrease)  from 
previous  year 

63% 

(181%) 

778% 

57% 

(131%) 

Earnings  (loss)  per 
share 

$(0.21) 

$(0.57) 

$0.75 

$(.014) 

$(.041) 

• Percent  increase 

(b) 

(decrease)  from 
previous  year 

63% 

(176%) 

636% 

66% 

(21%) 

(a)  Includes  a corporate  restructuring  charge  of  approximately  $1.7  million. 

(b)  Includes  a net  gain  of  $2.9  million  ($0.45  per  share)  from  the  sale  of  a 60%  interest  in 
Intelligenetics  to  Amoco  and  a $1.7  million  tax  credit  resulting  from  net  operating  loss 
carryforwards. 


IntelliCorp  management  attributes  the  lack  of  revenue  growth 
from  fiscal  1987  to  fiscal  1988  to  the  shifts  in  the  market  for  its 
products  and  services  away  from  specialized  hardware 
environments  toward  general  purpose  hardware. 

• The  realignment  initiated  in  July  1987,  together  with  a 
reduction  in  operating  expenses,  resulted  in  a revenue  increase 
of  8%  and  net  profit  of  $416,000  for  the  fourth  quarter  of  fiscal 
1988  (the  three  months  ending  June  30,  1988). 

• Revenue  for  the  three  months  ending  September  30,  1988 
reached  $5.4  million,  a 6%  increase  over  $5.1  million  for  the 
same  period  in  1987.  Net  income  was  $411,000,  compared  to 
net  losses  of  $649,000  for  the  same  period  a year  ago. 

As  of  June  30,  1988,  IntelliCorp  had  approximately  175  employees. 
The  company  currently  has  about  200  employees  worldwide. 
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IntelliCorp  competitors  include  Inference  Corporation, 
Teknowledge,  


Key  Products  and  Approximately  79%  of  IntelliCorp’s  fiscal  1988  revenue  was 
Services  derived  from  sofware  product  licenses  and  associated  support 

services.  The  remaining  21%  of  revenue  was  derived  from 
contract  research  and  consulting  professional  services. 

A three-year  summary  of  source  of  revenue  follows: 

INTELLICORP 

THREE-YEAR  SOURCE  OF  REVENUE  SUMMMARY 
($  thousands) 


FISCAL  YEAR 

6/88 

6/87 

6/86 

ITEM 

REVENUE 

$ 

PERCENT 
OF  TOTAL 

REVENUE 

$ 

PERCENT 
OF  TOTAL 

REVENUE 

$ 

PERCENT 
OF  TOTAL 

Software  and  relatec 
services 

$16,161 

79% 

$16,216 

80% 

$15,390 

83% 

Professional  services 

4,272 

21% 

4,136 

20% 

3,207 

17% 

TOTAL 

$20,433 

100% 

$20,352 

100% 

$18,597 

100% 

IntelliCorp  develops,  markets,  and  supports  knowledge  processing 
software  products  for  a range  of  hardware  environments.  The 
company  has  licensed  more  than  2,600  copies  of  its  software 
products  worldwide. 

• The  KEE  system  is  an  integrated  package  of  AI  development 
tools  that  provide  a programming  environment  for  building 
knowledge-based  systems  for  commercial  and  scientific 
applications.  The  principal  AI  technologies  represented  and 
integrated  by  the  KEE  system  are  rule-based  reasoning,  frame- 
based  representation,  and  object-oriented  programming. 

- At  June  30,  1988,  the  company  had  an  installed  base  of 
approximately  2,300  KEE  systems  delivered  to  over  700 
customer  sites.  IntelliCorp  delivered  approximately  650 
systems  during  fiscal  1988,  compared  to  700  systems  during 
fiscal  1987,  and  more  than  600  systems  during  fiscal  1986. 
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- KEE  is  available  for  the  IBM  PC  RT;  the  Apollo  Domain 
3000  and  4000  workstation  series;  Sun-3  and  Sun-4 
workstations;  Symbolics  3600  computers;  Texas  Instruments 
Explorer  I,  Explorer  II,  and  MicroExplorer  workstations;  and 
DEC  VAXstation  computers. 

- KEE  is  licensed  for  a per  copy  fee.  The  standard  price 
charged  for  an  initial  KEE  system  is  $44,000,  consisting  of  a 
$30,000  license  fee  and  $14,000  for  a support  package  that 
includes  training  and  one  year  of  software  maintenance  and 
support.  Volume  discounts  are  available. 

• An  Intel  80386-based  KEE  product,  introduced  in 1988, 

licenses  for  $15,000. 

• In  October  1987,  IntelliCorp  entered  into  an  agreement  with 
IBM  to  develop  a version  of  the  KEE  system  for  the  IBM 
System/370  series  of  mainframes.  The  product,  scheduled  for 
availability  in  December  1988,  will  be  called  IBM  KEE,  will 
carry  the  IBM  logo,  and  will  be  distributed  exclusively  through 
IBM.  IBM  KEE  will  have  an  initial  price  of  $98,000  for  a one- 
time charge  license  and  $4,900  for  a monthly  license.  Under 
the  agreement,  IntelliCorp  will  receive  a royalty  on  licenses  of 
IBM  KEE. 

• The  SimKit™  package,  released  in  November  1985,  adds 
simulation  and  modeling  capabilities  to  the  KEE  system. 

- SimKit  licenses  for  an  initial  one-year  fee  of  $21,000,  which 
includes  training  and  support.  Volume  discounts  are 
available. 

- SimKit  is  available  on  Sun-3,  Texas  Instruments  Explorer, 
and  Symbolics  workstations. 

• The  KEE  PC-Host  Delivery  System,  available  in  January  1986, 
allows  customers  that  have  developed  a knowledge-based 
system  using  the  KEE  software  on  a workstation  to  use  a host 
computer  running  Common  LISP  (for  example,  a DEC  VAX) 
in  combination  with  certain  microcomputers  (for  example  IBM 
PCs  and  compatibles)  to  deliver  a knowledge-based  system  to 
mircocomputer  users. 

- The  system  licenses  for  $7,500  to  $60,000  per  copy, 
depending  on  the  size  of  the  host  computer.  This  price 
includes  one  year  of  support.  There  is  an  additional  fee  for 
each  PC  connected  to  the  host. 
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• KEEconnection™,  announced  in  January  1987,  is  a bridge  for 
passing  information  between  data  bases  and  knowledge-based 
systems  built  with  KEE. 

- KEEconnection  is  available  on  Sun-3  and  Symbolics 
workstations.  The  data  base  to  which  the  workstations  are 
connect  may  be  on  either  a DEC  VAX  or  a Sun-3  computer. 

- Shipments  of  KEEconnection  began  in  December  1987.  The 
product  licenses  for  $15,200  to  $47,000  per  copy,  which 
includes  training  and  one  year  of  software  support. 

• KEE/C  Integration  Toolkit,  introduced  in  July  1987,  integrates 
programs  written  in  the  C language  with  knowledge-based 
applications  developed  using  IntelliCorp's  LISP-based  KEE 
system.  The  product  enables  developers  to  move  easily 
between  C,  KEE,  and  LISP  as  necessary,  depending  on  which 
programming  language  is  most  appropriate. 

- The  product,  which  shipped  beginning  in  February  1988,  is 
available  on  Sun-3  and  Sun-4  workstations. 

- The  KEE/C  Integration  Toolkit  licenses  for  $1,500  per  copy. 
Volume  discounts  are  available. 

• J-KEE  is  a Japanese  language  version  of  the  KEE  system  for 
Symbolics  workstations.  J-KEE  is  currently  marketed  in  Japan 
by  CSK  Corporation  (formerly  Computer  Services 
Corporation).  IntelliCorp  and  CSK  are  currently  jointly 
developing  a version  of  J-KEE  for  Sun-3  workstations. 

• IntelliCorp  is  developing  versions  of  the  KEE  system,  SimKit, 

and  KEEconnection  for  Hewlett  Packard's  HP  9000  series  of 
workstations.  Availability  is  scheduled  for . 

KEEtutor™,  introduced  in  January  1988,  is  an  expert  systems 
software  training  package  that  is  designed  to  be  used  without  the 
supervision  of  an  instructor. 

• The  package  contains  two  video  cassette  tapes,  training 
software  in  either  tape  or  floppy  format,  and  five  sets  of  tutorial 
modules  that  cover  the  basic  features  of  the  KEE  system. 

• KEEtutor  is  designed  for  use  with  KEE  3.1  software  and  is 
available  on  80386-based  microcomputers,  Sun  Microsystems, 
Symbolics,  Texas  Instruments  Explorer  and  MicroExplorer,  and 
DEC  VAXstation  computers.  Additional  releases  are  planned 
for  IBM  RT  and  HP  computers. 
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• KEEtutor  is  priced  at  $4,000  to  $5,000  per  copy,  depending  on 
the  number  of  copies  of  supporting  materials  ordered  by  the 
customer. 

IntelliCorp  provides,  on  a contract  basis,  custom  development 
professional  services.  The  company  undertakes  these  projects  to 
help  customers  successfully  commence  development  of  their 
applications  and  to  help  broaden  the  capabilities  of  the  KEE 
system. 

• IntelliCorp  occasionally  licenses  unproductized  software 
modules  to  customers  in  connection  with  custom  system 
projects. 

• Major  custom  system  projects  during  fiscal  1988  include  the 
following: 

- A plant  modelling  systm  for  electric  utilities  sponsored  by 
the  Electric  Power  Research  Institute. 

- A new  software  tool  for  the  Airland  Battle  Mangement 
System  being  developed  by  Lockheed  Austin  division  under 
sponsorship  of  the  Defense  Advanced  Research  Projects 
Agency  (DARPA)  and  the  U.S.  Army. 

- A configuration  system  for  a large  vehuicle  manufacturer. 

- A scheduling  system  for  a semiconductor  firm. 

- In  February  1988,  DARPA  awarded  IntelliCorp  a 15-month, 
$600,000  contract  to  develop  two  custom  knowledge  systems 
for  internal  administration  management  related  to  order 
processing  and  financial  data  tracking. 

- In  February  1988,  IntelliCorp  was  awarded  a two-year 
$750,000  contract  cofunded  by  DARPA  and  NASA  to 
conduct  research  into  the  use  of  "truth  maintenance" 
software  methods  in  automatic  planning. 

• IntelliCorp  continues  to  provide  research  and  development 
services  to  DARPA  for  the  Expert  System  Development  Tool 
(ESDT)  which  is  used  by  the  U.S.  Department  of  Defense, 
related  government  agencies,  and  contractors  working  on 
Department  of  Defense  and  related  agency  projects. 

- ESDT,  which  includes  the  core  of  the  KEE  system,  was 
delivered  in  May  1987.  Ongoing  efforts  under  the  contract 
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Industry  Markets 

include  the  development  of  functional  additions  to  the 
ESDT. 

- IntelliCorp  retains  rights  to  commercialized  the  ESDT. 

- IntelliCorp  has  realized  about  $2.3  million  in  revenue  from 
this  contract  through  the  end  of  fiscal  1988.  Additional 
funding  of  approximately  $500,000  is  anticipated. 

IntelliCorp's  products  are  marketed  to  clients  in  the  aerospace, 
energy,  finance,  manufacturing,  and  telecommunications  industries 
and  to  the  federal  government.  The  company's  customers  are 
primarily  large  corporations,  government  agencies,  and 
universities. 

Approximately  14%  of  fiscal  1988  revenue  was  derived  from  the 
federal  government. 

IntelliCorp  clients  include  The  Defense  Advanced  Research 
Projects  Agency  (DARPA),  Northro  Corporation,,  Minnesota 
Mining  and  Manufacturing,  Nippon  Life,  Manufacturers  Hanover 
Corporation,  Boeing,  Rockwell  International's  Avionics  Group, 
Electric  Power  Research  Institute, 

Geographic 

Markets 

Approximately  75%  ($15.3  million)  of  IntelliCorp's  fiscal  1988 
revenue  was  derived  from  the  U.S..  The  remaining  25%  of 
revenue  was  derived  from  export  sales,  with  18%  ($3.7  million) 
derived  from  Europe,  and  7%  ($1.4  million)  derived  from  the  Far 
East. 

In  addition  to  its  headquarters  in  Mountain  View  (CA),  the 
company  has  U.S.  sales  offices  in  Boston,  Chicago,  Dallas,  Denver, 
Philadelphia,  New  York,  and  Washington,  D.C. 

International  offices  are  located  in  Germany  and  the  U.K. 

IntelliCorp's  products  are  distributed  by  CSK  Corporation  in 
Japan,  by  certain  distributors  in  Scandinavia  and  Israel,  and  by 
independent  sales  representatives  in  France  and  Italy. 

IntelliCorp  has  cooperative  marketing  agreements  with  several 
hardware  manufacturers  (Symobolics,  Texas  Instruments,  Hewlett 
Packard,  Sun  Microsystems,  Apollo,  DEC,  and  IBM)  that  market 
the  KEE  system  with  their  hardware. 
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IBM  CORPORATION 
Max  Fiszer 

Manager,  F'roiect  Office 
Programming  Systems  Division 
2800  Sand  Hill  Road 
Meno  Park,  CA  94025 

REASON 

858-3012  


Sa  1 es 


c- 

11/17/88  - Max  was  referred  to  us  by  Jim  j?ates  of  IBM.  (Bee  PAC 
contact  report  dated  11/3.)  He  is  manager  of  the  Project  Office  for 
Knowledge  Based  Systems  in  the  Programming  Systems  Division  of  IBM. 
While  that  office  is  not  responsible  for  the  development  or  acquisition 
of  particular  knowledge  based  software  products,  it  is  responsible  for 
everything  else  including  support,  marketing,  etc. 

Max  indicated  that  they  were  focusing  on  three  products,  all  mainframe 
based,  that  are  directed  at  three  different  types  of  users.  The  first, 
Expert  Systems  Environment,  is  a.  tool  directed  at  end  users.  The 
second,  Knowledge  Tool,  is  F'Ll  based  and  designed  to  support  DP 
professionals.  The  third,  is  or  will  be  purchased  and  is  called  " klEY"  , 
a product  of  Intel licorp.  When  released  by  IBM  this  tool  will  be 
called  "IBM  J&jpy'"  and  is  a LISP  oriented  product  primarily  aimed  at 
supporting  AI  and  Expert  Systems  applications  developers.  All  three 
products  will  be  delivered  over  networks. 

Max  indicated  that  IBM  was  making  a very  large  investment  in  knowledge 
based  systems.  There  are  over  100  people  involved  in  Menlo  Park,  and 
probably  300  hundred  more  if  you  count  the  efforts  in  Bethesda, 
Gaithersberg , and  IBM's  prime  research  facility.  Their  strategy  is  to 
have  tools  which  can  be  either  easily  integrated  directly  into  other 
applications,  or  which  support  the  development  of  knowledge  based 
applications  that  can  be  easily  integrated  into  other  applications 
environments.  He  estimates  that  there  are  perhaps  500  installations  of 
host  based  knowledge  based  software  environments,  and  perhaps  207.  of 
these  have  production  applications  of  some  sort  or  another. 

It's  IBM's  feeling  that  there  are  probably  about  2000  insta 1 1 ations  of 
similary  software  at  the  workstation  (Sun,  Applo)  level;  and  about 
10000  installations  at  the  PC  level.  IBM  also  feels  that  the  Service 
Sector  is  taking  the  lead  in  the  application  of  this  type  of 
technology  and  cited  the  insurance  industry  in  particular. 

IBM  is  potentially  interested  in  having  INPUT  investigate  a number  of 
items;  including: 


1.  Users  (all  three  classes)  reactions  to  the  software  systems  they 
are  currently  using  (IBM  and  Mon-IBM). 

2.  Users  impressions  of  IEiM's  mainframe  approach  to  providing  tools 
that  will  facilitate  the  integration  of  knowledge  based 
applications  into  the  production  environment. 

In  the  first  category  they  would  like  to  know:  What  tools  are  they 
using,  (and  presumably  for  what  kinds  of  applications),  their 
perceptions  of  the  strengths  and  weaknesses  of  the  tools,  etc. 

I discussed  INPUT'S  approach  to  Custom  Work  and  touted  Benny  White's 
experience  in  this  particular  area.  Nancy  reviewed  INPUT'S  general 
capabilities  and  gave  Max  some  literature  and  a report  to  look  over. 

I agreed  to  prepare  a preliminary  work  statement  of  what  we  might  do 
to  address  IBM's  requirements,  and  get  it  to  Max  by  Monday.  This  does 
not  need  to  be  a formal  proposal,  but  should  include  some  feeling  for 
a ball  park  price.  I suggested  that  he  should  follow  up  with  Denny 
Whi.  te . 

I believe  that  they  have  money  to  spend  this  year  and  if  we  come  up 
with  a price  that  is  perhaps  to  large,  we  could  segment  the  project  to 
get  it  into  two  different  budget  periods. 


===========================  ACTION  items  ================================= 

name  action  description  by  when  done  time 


DWayson  Provide  Work  Scope  11/18/88 

DWhite  Follow  Up  As  Appropriate 
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Relative  Product  Positions  and 
Expected  Movement: 
INPUT’S  View 


Strong 


AI 

Functions 


Weak 


Weak  Strong 

Production  Functions 
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Future  (1990-on)  Product  Directions: 
Vendor  Interviews 


• AICorp-KBMS 

- Operation  on  more  hardware  platforms:  DEC  VAX, 
Unix  workstations 


• Aion  - ADS 

- Support  for  AS/400? 

- Implementation  of  IBM’s  SAA 


• IBM  - ESE 

- More  AI  capabilities 

- Wider  database  access 

- Operation  on  more  hardware  platforms:  AS/400 

- “Non-monotonic”  reasoning 

• Neuron  Data  - NEXPERT 

- “Knowledge  acquisition  module”:  System  will  extract 
KB  from  expert  through  dialog 

- Learning  systems:  Rules  will  be  developed  by  system 
from  monitoring  of  production  experience 
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Neuron  Data  - NEXPERT 

Next  Release:  Vendor  Interviews 


• Date 

- Summer  1989 


• New  capabilities 

- MVS -based  mainframe  run-time  environment 

CICS,  TSO,  DB2,  SQL/DS,  VSAM,  IMS 

- DB2  and  DL/1  access  through  SQL/DS 

- Full  semantic  net 

- Graphics  tool  kit  for  end-user  screen  painting 
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IBM  - ESE 

Next  Release:  Vendor  Interviews 


• Date 

- March  1989 


• New  capabilities 

- DOS-based  PC  consultation  environment 
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Next  Release:  Vendor  Interviews 


• Date 

- Summer  1989 


• New  capabilities 
- Full  object-oriented  development 
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AI  Corp.  - KBMS 

Next  Release:  Vendor  Interviews 


• Date 
- April  1989 


• New  capabilities 

- 90%  decrease  in  mainframe  utilization 

- Support  for  multiple  shared  development 

- OS/2  version 

- Standalone  or  cooperative  processing 

- MS-DOS  execution  version 
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Today’s  Product:  Vendor  Interviews 

• Hardware 

- Mac,  PC,  VAX,  Unix  workstation, 

• Mainframe  operating  systems 

- VM  (January  1989) 

• Mainframe  transaction  processing 

- (Not  yet) 

• Standard  file  and  database  interfaces 

- Through  SQL:  Lotus,  Excel,  dBASEIII,  Oracle, 

Sybase,  Ingres,  Informix 

• Application  interfaces 

- 2-way  function  calls 

• SQL  support 

- Yes 

• Top  industries  and  applications 

- Aerospace:  Diagnosis,  quality  control  of 
manufacturing 

- Financial  services:  Trading,  recommend  products, 
insurance  evaluation 

- Manufacturing:  Configuration  of  parts, 
manufacturing  control 

• Pricing 

- $5,000  base,  Mac  or  PC 

- $8,000  base,  VAX  or  Unix  workstation 

- $2,000  to  $25,000  base,  depending  on  workstation 
size 
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IBM  ■ ESE 

Today’s  Product:  Vendor  Interviews 


• Hardware 

- Mainframe 

• Mainframe  operating  systems 

- VM,  MVS 

• Mainframe  transaction  processing 

- TSO,  CMS,  IMS,  CICS 

• Standard  file  and  database  interfaces 

- VS  AM,  SQL-based  interfaces 

• Application  interfaces 

- Call  out  from  ESE  to  application 

• SQL  support 

- Yes 

• Top  industries  and  applications 

- Insurance:  Underwriting,  claims 

- Manufacturing:  Diagnosis,  configuration 

- Finance:  Loan  authorization 

• Pricing 

- $35,000  base,  development  system;  $7,500 
consultation  only 
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Aion  - ADS 

Today’s  Product:  Vendor  Interviews 

• Hardware 

- Mainframe  or  PC 

• Mainframe  operating  systems 

- Any  one 

• Mainframe  transaction  processing 

- IMS,  CICS 

• Standard  file  and  database  interfaces 

- VSAM,  QSAM,  SQL/DS,  DB2,  DL/1 

• Application  interfaces 

- 2- way,  in-memory  transfer  of  data,  applications  in  C, 
Pascal,  Cobol,  PL/I 

• SQL  support 

- Yes 

• Top  industries  and  applications 

- Insurance:  Underwriting,  claims 

- Oil  and  gas:  Chemical  blending,  treatment,  help  desk 

- Telecommunications:  Network  design 

• Pricing 

- $60-70,000  base  (MVS  vs.  VM),  options  can  take 
total  to  $155,000 
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AT  Corp.  ■ KBMS 

Today’s  Product:  Vendor  Interviews 


• Hardware 

- Mainframe 

• Mainframe  operating  systems 

- VM,  MVS/XA 

• Mainframe  transaction  processing 

- CICS,  TSO,  IMS/DC,  IDMS/DC,  CMS 

• Standard  file  and  database  interfaces 

- DB2,  DL/1,  VS  AM,  IDMS-R,  ADABASE 

• Application  interfaces 

- 2-way,  through  embedded  SQL  statements;  Cobol  or 
PL/I 

• SQL  support 

- Yes 

• Top  industries  and  applications 

- Insurance:  Underwriting,  claims 

- Retail  trade:  Pricing  of  orders 

• Pricing 

- $90,000  base,  options  can  take  total  to  $160,000 
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Is  the  Product  at  the  “State  of  the  Art”? 
Which  Others  Are? 


v 


Vendor  - 
Product 


AI  Corp.  - 
KBMS 


Number  of 
Mentions 


Yes  No  Not 
Sure 


6 0 0 


Aion  - ADS 


7 1 2 


IBM  - ESE 


1 8 1 


Neuron  Data 
- NEXPERT 


9 


0 


\ 

Others  Cited 


Aion  - ADS 
Inference  Corp.  - ART 
Neuron  Data  - NEXPERT 
Intellicorp  - KEE 

No  others  at  “state”  (3) 
Neuron  Data  - NEXPERT 
Intellicorp  - KEE 
AI  Corp.  - KBMS 
Texas  Instru.  - PC  Cons. 
Knowledge  Bldrs  - Level  5 
IBM  - Knowledge  Tool 

Aion  - ADS  (4) 

AI  Corp  - KBMS  (3) 
Intellicorp  - KEE  (3) 
Inference  Corp.  - ART  (3) 
Carnegie  - Knowl.  Craft 
Knowl.  Garden-Knowl.  Pro 
Neuron  Data-NEXPERT 

Intellicorp  - KEE  (6) 

Gold  Hill  - GoldWorks  (5) 
Inference  Corp.  - ART  (3) 
Carnegie  - Knowl.  Craft 
LISP 

No  others  at  “state” 

INPUT- 


ZESP  n-62 


r 


— 

Neuron  Data  ■ NEXPERT 

“Feature  Wish  List”: 

Priority  Analysis 


Feature  or  Function 

Number  of  Times  Stated  as: 
“Must  Have”  “Nice  to  Have” 

Window-based  floating- 

1 

point  operations 

Better  message  passing 

1 

between  objects 

Additions  to  C-routine 

1 

libraries 

Multiple  attributes  for  a 

1 

property 

Better  control  of  forward 

1 

chaining 

Better  Mac  to  PC  transfer 

1 

of  text 

Debugging  access  to  rule 

1 

firing  sequence 

Easier  PC-to-PC  transfer, 

1 

different  configurations 

Remove  copy  protection 

1 

(AT  version) 

(None) 

1 
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Neuron  Data  - NEXPERT 


“Feature  Wish  List”: 
Priority  Analysis 


Feature  or  Function 

Number  of  Times  Stated  as: 
“Must  Have”  “Nice  to  Have” 

Better  tools  for  end- 
user  graphics 

3 

2 

Better  documentation: 
more  examples,  depth 

2 

1 

Interfaces: 

- Stronger  DB  interfaces 

1 

- Better  interface  with 
applications 

1 

Full  semantic  net 
(not  partial) 

1 

1 
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IBM  ■ ESE 


“Feature  Wish  List”: 
Priority  Analysis 


Feature  or  Function 

Number  of  Times  Stated  as: 
“Must  Have”  “Nice  to  Have” 

Multiple  current 

1 

instantiations 

View  trace  during 

1 

consultation  session 

“Else”  capability 

1 

Better  number/string 

1 

conversion 

Bring  AI  functions  up  to 

1 

competition 

Given  capabilities,  make 

1 

easier  to  develop 

(Scrapping  product  in 

1 

favor  of  KEE) 

More  explicit  manual, 

1 

good  examples 

Control  of  end-user 

1 

screens  by  rules 

Non-GDDM  end-user 

1 

graphics 

Hard-copy  report 

1 

generation 

Decreased  impact  on 

1 

mainframe  processor 

Cooperative  processing 

1 

Graphics-based 

1 

development 

(None) 

1 
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IBM  - ESE 


“Feature  Wish  List”: 
Priority  Analysis 


Feature  or  Function 

Number  of  Times  Stated  as: 
“Must  Have”  “Nice  to  Have” 

Interfaces: 

- Better  interfaces  to 
applications 

1 

- Call  expert  system  from 
another  appli. 

1 

- Interface  with  IMS 
applications 

1 

- DB  interfaces:  IDMS, 
dBASEIII,  CICS,  VSAM 

1 

- Better  interfacing 
instructions 

1 

Object-oriented 

development 

2 

1 

PC  development/ 
production 

2 

CICS  version 

2 

Conditional  infer., 
Focus  Control  Blocks 

1 

1 
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Aion  - ADS 


“Feature  Wish  List 
Priority  Analysis 


H . 


Feature  or  Function 

Number  of  Times  Stated  as: 
“Must  Have”  “Nice  to  Have” 

Inheritance 

1 

Infer  rules  from  examples 

1 

Better  date  manipulation, 

1 

other  formats 

Improved  string  searching 

1 

Better  editing  of  data  from 

1 

databases 

Direct  user  access  if 

1 

embedded  in  IMS,  CICS 

Better  back  up  for  crashes 

1 

End-user  graphical  objects 

1 

(like  meters) 

Faster  operation  in 

1 

production 

Diagramming  of  knowledge 

1 

bases 

Non-monotonic  reasoning 

1 

(common  sense) 

Better  tracing  and 

1 

explanation 

Direct  access  to  IDMS-R 

1 

files 

Stronger  report  generation, 

1 

incl.  columns 

(None) 

1 
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Aion.:  ADS 


“Feature  Wish  List”: 
Priority  Analysis 


Feature  or  Function 

Number  of  Times  Stated  as: 
“Must  Have”  “Nice  to  Have” 

Cooperative  processing 

1 

1 

Object-oriented 
development  (strengthen) 

1 

1 

Frames 

1 

1 

Expanded  memory 

2 

Flexible  options  to 
format  end-user  screens 

2 
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AI  Coro.  - KBMS 


“Feature  Wish  List”: 
Priority  Analysis 


Feature  or  Function 

Number  of  Times  Stated  as: 
“Must  Have”  “Nice  to  Have” 

Copy  and  reuse  blocks 

1 

of  rules 

Split  screen/windowing  for 

1 

development 

Faster  operation 

1 

Better  object  inheritance 

1 

Place  comment  statements 

1 

in  code 

Rule/pattem  induction  from 

1 

examples 
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“Feature  Wish  List”: 
Priority  Analysis 


Feature  or  Function 

Number  of  Times  Stated  as: 
“Must  Have”  “Nice  to  Have” 

PC  development/ 

3 

1 

production 

Modular,  shared 

3 

1 

development 

INPUT®  J 
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Highest-Priority  Missing  Features: 
Cross  Comparison 


A 


Missing 

Feature  or  Function 

AI  Corp.  Aion  IBM  Neuron 

KBMS  ADS  ESE  Data 

NEXPERT 

Object-oriented  dev’t 

X X 

Frames 

X 

Cond’l  inferencing,  FCBs 

X 

Full  semantic  net 

X 

Tools,  end-user  graphics 

X 

Modular,  shared  dev’t 

X 

PC  development/prod ’n 

X X 

Expanded  memory 

X 

Cooperative  processing 

X 

CICS  version 

X 

Improved/new  interfaces 

X X 

Better  documentation 

X 
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Highest-Priority  Missing  Features: 

Table 


Vendor  - Product 

Missine  Features  or  Functions 

• AICorp.-KBMS 

- Modular,  shared  development 

- PC  development/production 

• Aion  - ADS 

- Object-oriented  development 
(strengthen) 

- Frames 

- Expanded  memory 

- Cooperative  processing 

- Flexible  options  to  format  end- 
user  screens 

• IBM  - ESE 

- Object-oriented  development 

- Conditional  inferencing,  Focus 
Control  Blocks 

- PC  development/production 

- CICS  version 

- Improved/new  interfaces 

• Neuron  Data  - 
NEXPERT 

- Full  semantic  net  (not  partial) 

- Better  tools  for  end-user 
graphics 

- Improved/new  interfaces 

- Better  documentation 

v 
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N^urQ.n.Data  - NEXPERT 


Other  Weaknesses 


• Limited  end-user  graphics  capabilities 

(2  of  10) 

- Must  supplement  with  expensive  outside  products 

- Not  machine-independent/portable 


• “No  significant  weaknesses” 

(1  of  10) 
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Neuron  Data  - NEXPERT 

Top  Weaknesses 

• Some  problems  with  AI  and  production 
functionality 

(7  of  10) 

- To  edit  must  move  between  development  and 
production  environments 

- Naming  of  objects  not  flexible  enough 

- Lacks  object  message  passing 

- Impacts  of  “demons”  not  clear 

- Hard  to  control  forward  chaining 

- Needs  a full  semantic  net  (not  just  partial) 

- Needs  the  flexibility  of  LISP 

- Portability  and  interfacing  not  as  good  as  claimed 

- Need  new  C-routines  in  library  for  error  analysis 

- With  Macintosh,  database  interfaces  are  limited 

• Documentation  needs  improvement 

(5  of  10) 

- Some  errors 

- Full  use  of  some  commands  not  covered 

- Not  presented  clearly,  tough  to  use 

- OK  as  reference,  but  not  enough  “how  to” 

- Not  well  organized  or  indexed 

- Special  problems:  Sun  workstation  platform 

• Problems  in  vendor  support 

(2  of  10) 

- Distribution/support  split:  Vendor,  Bechtel,  DEC 

- Sometimes  tough  to  get  answers 

- Vendor  seems  worried  about  stealing  of  secrets 

• Some  bugs  and  crashes 

(3  of  10) 

- Better  now 

- Compared  to  LISP,  product  still  immature 

- Some  very  ungracefiil  crashes  encountered 

- Hard  to  find  some  crash  sources 
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Neuron  Data  - NEXPERT 

Other  Strengths 

• Can  be  embedded  within  existing  applications 

(2  of  10) 

- Easy  because  C-based 

• Fast  in  execution 

(2  of  10) 

- Because  C-based  (?) 
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Neuron  Data  - NEXPERT 

Top  Strengths 

• Strong  “hybrid”  environment  of  objects  and  rules 

(8  of  10) 

- “A  powerful  combination” 

- “More  than  the  sum  of  the  parts” 

- Provides  great  flexibility  and  productivity  for  developers 

- Makes  application  maintenance  easier 

- Inheritance  handled  well 

- Permits  good  control  of  inferencing  sequences 

- Ideal  for  process  control,  production,  configuration 
applications 

- Supports  implementation  of  LISP  routines 


• Graphics-based  development 

(7  of  10) 

- Greatly  speeds  application  development 

- Provides  clarity  in  managing  structure  of  rules  and  objects 

- Very  effective  windowing 

- “An  intuitive  approach  to  development” 

• Portable  among  Macintosh,  VAX,  and  PC 

(7  of  10) 

- Excellent  C-based  approach  to  portability 

- Can  support  other  environments  in  future 

- Can  develop  in  one  environment  (Mac)  and  deliver  in  other 
(PC) 

- Fits  with  installed  production  machines 


V 


Good  interfaces  with  databases  and  other 
applications 

(5  of  10) 

- C-based  strategy  works  well  for  interfaces 

- Applications  interfaces  operate  either  way 

- Vendor-provided  run-time  libraries  in  C save  time 

- “Connects  well  with  our  pre-existing  DBs  and  applications” 

INPUT*  ^ 
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Strengths  and  Weaknesses: 
Summary 

• Significant  strengths 

- Strong  hybrid  of  objects  and  rules 

- Graphics-based  development 

- Macintosh/VAX/PC  portability 

- Database  and  application  interfaces 

• Significant  weaknesses 

- Some  AI  functions 

- Documentation 

- Vendor  support 

- Bugs  and  crashes 


v. 
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IBM  ■ ESE 


Other  Weaknesses 


• DB2  is  the  only  database  interface 

(2  of  10) 

- Other  databases  are  important  also 

• “No  significant  weaknesses” 

(2  of  10) 


• Lack  of  portability  between  mainframe  and  PC 

(1  of  10) 

- Desirable  for  both  development  and  production 


• Not  easy  enough  to  develop  with 

(1  of  10) 

- Versus  PC-based  products  with  comparable 
functionality 
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IBM  - ESE 


Top  Weaknesses 


"N 


• Major  pieces  of  AI  functionality  are  missing 

(7  of  10) 

- Functionality  is  not  up  to  the  level  of  the  competition 
(KBMS) 

- Cannot  handle  sophisticated  applications 

- Cannot  merge  two  modules  of  a knowledge  base 

- Rule  editing  is  awkward  with  small  on-screen  window 

- Lack  of  inferencing  control,  thus  get  inappropriate 
rule  jumps 

- Forward  chaining  needs  pattern  matching,  and  to  be 
event-driven 

- Missing  “else”  function  doubles  number  of  rules 

- Lack  of  multiple  current  instantiation  requires  repeat 
handling 

- Object-oriented  environment  would  reduce  coding 
substantially 

- Maintenance  would  be  much  easier  if  object  oriented 

- Needs  object-based  inheritance 

- Cannot  watch  trace  facility  during  consultation 

- No  hard-copy  reports  of  reasoning  behind 
recommendations 

• Missing  some  production-oriented  functionality 

(6  of  10) 

- Lots  of  abends  result  if  environment  not  set  up  right 

- With  memory  limitations,  an  abend  means  major  loss 
of  data 

- Need  a compiled  version  for  faster  performance 

- CICS  production  environment  is  not  fully  supported 

- Need  interface  for  existing  IMS  applications 

- For  CPU  planning,  need  ability  to  project  production 

resources 
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IBM  - ESE 


A 


Other  Strengths 


• Good  graphics  capabilities 

(2  of  10) 

- Can  interface  with  IBM  GDDM  for  end-user  graphics 

- Can  tie  definition  of  graphics  to  data  elements 


• “No  significant  strengths” 

(1  of  10) 
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IBM-iE£E 


Top  Strengths 


• Easy  to  learn  and  develop  with 

(5  of  10) 

- Can  get  programmers  up  and  running  fast 

- No  experience  in  expert  systems  required 

- Simple  applications  can  be  developed  quickly 

- Vendor-provided  sample  applications  very  useful 

- System  documents  the  application  automatically 

- End-users  can  make  changes  to  knowledge  base 


• Some  good  AI-  and  production-oriented  functions 

(6  of  10) 

- Rule  editors  help  enforce  syntactic  consistency,  save 
time 

- Effective  tracing  of  rule  firing  aids  debugging 

- Rule  nesting  gives  developers  good  visibility  and 
access 

- Developer  can  immediately  see  end-user  impact  of 
KB  changes 

- Good  explanation  features  are  built  in 

- Rel.  1.1  provides  good  response  time 

- Can  test  under  VM  and  run  production  under  MVS 

- Effective  tool  for  configuration  problems 


Vendor  strength  and  support 

(3  of  10) 

- Vendor  stable  and  committed  to  product 

- Documentation  and  hands-on  support  speeds  learning 

- Both  local  and  national  support  provided 

INPUT*  ^ 
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IBM  ■ ESE 

Strengths  and  Weaknesses: 

Summary 

• Significant  strengths 

- Ease  of  development 

- Some  good  AI  functions 

- Good  production  functions 

- Vendor  strength 

• Significant  weaknesses 

- Missing  AI  functionality 

- Missing  production  functionality 
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AiQQ-— ADS 


Other  Weaknesses 


• Database  access  could  use  some  extensions 

(2  of  10) 

- Needs  better  discrimination  among  data  types 

- No  direct  link  with  IDMS-R  files 


• Large  knowledge  bases  cannot  be  run  in  PC 
memory 

(2  of  10) 

- PC  performance  can  be  too  slow 

- PC  runs  out  of  memory;  Rel.  5.0  to  correct  for  PS/2? 


• Performance  can  be  slow 

(1  of  10) 

- Compared  to  a compiled  language 

- Limits  ability  to  embed  within  high- volume 
applications 


• Documentation  could  use  improvement 

(1  of  10) 

- Tough  to  find  some  information 

- Need  better  indexing  and  examples 


• Editor  for  end-user  screens  cumbersome 

(1  of  10) 

- Too  much  work  to  achieve  some  results 
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Top  Weaknesses 


• Some  useful  AI  functionality  is  missing 

(3  of  10) 

- Tough  to  manage  150-plus  rules;  need  more 
diagramming 

- Should  offer  inferring  of  rules  from  examples 


• “No  significant  weaknesses” 

(2  of  10) 
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Aion  - ADS 


Other  Strengths 


• Can  be  embedded  within  existing  applications 

(1  of  10) 

- User  sees  a single,  integrated  application 

• Can  share  development  among  knowledge 
engineers 

(1  of  10) 

- Easy  to  integrate  modules 

- Splitting  job  speeds  prototyping 


• Good  text  handling  in  tailored  reports 

(1  of  10) 

- Reports  are  critical  for  data  analysis  application 
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Aion  ■ ADS 


More  Top  Strengths 


• Vendor  strength,  support,  and  credibility 

(5  of  10) 

- Product  still  growing,  in  right  ways 

- Founders  involved  and  listen  to  needs 

- Year  ago:  Added  access  to  multiple  transaction 
environments 

- Coming  in  Rel.  5.0:  Cooperative  processing 

- Coming  in  Rel.  5.0:  Object-oriented,  frames, 
inheritance 

- Rapid  response  to  problems,  questions 

- Excellent  overall  support  level 

- Vendor  delivers  as  promised 


• Interfaces  well  with  files  and  databases 

(2  of  10) 

- VS  AM,  DL/1,  DB2,  dBASE3  all  supported 

- No  problems  with  formats  of  existing  databases 
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Aion  - ADS 


Top  Strengths 


Superior  overall  AI-  and  production 
functionality 

(9  of  10) 


oriented 


- Easy  for  developers  to  learn  and  use 

- Best  product  on  the  market” 

- Very  wide  range  of  capabilities 

Development  environment  very  consistent  internally 

- Good  structure  for  control  of  inferencing  and  chaining 
Built  for  integration  with  IBM  production 
environment 


- Excellent  editing,  tracing,  and  debugging 

- Good  procedural  capabilities,  like  looping  and  nesting 


Portability  between  mainframe  and  PC 

(6  of  10) 

- Develop  on  one,  implement  on  that  or  other 
Multiple  mainframes  can  share  one  application 

- Large  knowledge  base  on  PC  feasible 

Flexible  PC  development,  controlled  mainframe 
production 


INPUT® 
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Strengths  and  Weaknesses 
Summary 
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• Significant  Strengths 

- Superior  AI  functionality,  overall 

- Good  production  functions 

- Mainframe/PC  portability 

- Vendor  strength 

- Database  interfaces 

• Significant  Weaknesses 

- Some  missing  AI  functionality 

- “None” 
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AI  Corp.  - KBMS 


Other  Weaknesses 


• Needs  better  interfaces  to  databases 

(1  of  6) 

- Substantial  work  to  set  up  database  interfaces 


• Limited  hard-copy  reporting  capabilities 

(1  of  6) 

- Report  tables  must  be  “hand  massaged” 

• Hard  to  share  development  among  knowledge 
engineers 

(1  of  6) 

- Must  manually  integrate  work  of  several  developers 


• Text-based,  not  graphical 

(1  of  6) 

- Would  be  easier  to  use  with  graphical  development 
interface 
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AI  Corp.  - KBMS 


Top  Weaknesses 


• New  product,  still  has  some  bugs 

(3  of  6) 

- Bugs  disrupt  development 


• Performance:  Too  much  CPU  resource,  slow 
response  time 

(2  of  6) 

- Limits  effective  size  of  knowledge  base 
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AI  Corp,  - KBMS 


Top  Strengths 


• Object-oriented  environment 

(5  of  6) 

- Easy  definition,  development,  and  maintenance 

- Simple  and  rich  representation  of  knowledge 

- One  object  replaces  several  rules 


• Solid  AI  functions,  especially  chaining 

(4  of  6) 

- “A  solid  implementation” 

- Most  of  the  needed  functions  are  present 

- Good  control  of  forward  and  backward  chaining 


• Interfaces  with  databases 

(4  of  6) 

- Applications  depend  on  existing  mainframe  databases 

- Objects  make  defining  interfaces  easier 


• Operation  on  the  IBM  mainframe 

(3  of  6) 

- Company-standard  computing  environment 

- Practical  problem-solving  in  a production 
environment 
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AI  Corp.  - KBMS 


Strengths  and  Weaknesses: 
Summary 


• Significant  Strengths 

- Object-oriented 

- Chaining,  other  AI  functions 

- Database  interfaces 

- Mainframe-based 


• Significant  Weaknesses 

- New-product  bugs 

- Performance 
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Top  Mentions  of 
Strengths  and  Weaknesses: 
Cross  Comparison 


Factor  mentioned 

Vendor  - 

Product 

AI  Corp. 
KBMS 

Aion 

ADS 

IBM 

ESE 

Neuron 

Data 

NEXPERT 

AI  functions 

+ 

+ 

- 

+ 

Object-oriented 

+ 

+ 

Graphics  for  dev’t 

+ 

Ease  of  development 

+ 

+ 

+ 

+ 

Production  functions 

+ 

+ 

Mainframe-based 

+ 

Portability 

+ 

+ 

Interfaces 

+ 

+ 

+ 

+ 

Performance 

- 

Bugs 

- 

- 

Crashes 

- 

Vendor 

+ 

+ 

- 

Documentation 

- 

v. 


Key:  “+”  = significant  strength,  = significant  weakness 
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Top  Mentions  of 
Strengths  and  Weaknesses: 
Table 


r 


v. 


Vendor  - Product 

Strengths 

Weaknesses 

AI  Corp.  - KBMS 

- AI  functions 

- Object-oriented 

- Mainframe-based 

- Interfaces 

- Performance 

- Bugs 

Aion  - ADS 

- AI  functions 

- Production 
functions 

- Portability 

- Interfaces 

- Vendor 

- (None 
significant) 

IBM  - ESE 

- Ease  of 
development 

- Production 
functions 

- Interfaces 

- Vendor 

- AI  functions 

Neuron  Data  - 
NEXPERT 

- AI  functions 

- Object-oriented 

- Graphics  for 
dev’t 

- Portability 

- Interfaces 

- Bugs 

- Crashes 

- Vendor 

- Documentation 

INPUT® J 
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■ \ 
Data-Distrubution  Backup 
for  Specific  Satisfaction  Charts 


CLIENT  data  File  spread17 

Question  7 


AI  Corp.  - KBMS 

01 

02 

03 

04 

05 

06 

07 

08 

09 

10 

Avg.  NotNorml 

7a- Range 

4 

5 

4 

4 

5 

4 

6 

4.3 

7b- CPU 

2 

2 

3 

3 

2 

5 

2.4 

7f-Mainframe 

2 

2 

3 

4 

2 

5 

2.6 

7g-Ease 

4 

4 

4 

5 

5 

4 

6 

4.3 

7h- Integration 

2 

4 

5 

4 

5 

3 

6 

3.8 

7i-Docunentation 

3 

4 

4 

4 

4 

3 

6 

3.7 

7j-Maintenance 

4 

4 

5 

5 

3 

5 

4.2 

7k-Customer 

4 

3 

3 

5 

5 

4 

6 

4.0 

71-Satisfaction 

3 

4 

4 

4 

5 

4 

6 

4.0 

A ion  - ADS 

01 

02 

03 

04 

05 

06 

07 

08 

09 

10 

#R 

Avg.  NotNorml 

7a- Range 

4 

4 

5 

4 

4 

4 

4 

4 

4 

5 

10 

4.2 

7b- CPU 

4 

3 

5 

4 

5 

4 

3 

3 

4 

9 

3.9 

7f-Mainframe 

4 

5 

4 

5 

4 

S 

5 

5 

8 

4.6 

7g-Ease 

5 

5 

5 

2 

5 

4 

3 

4 

5 

5 

10 

4.3 

7h- Integration 

5 

4 

5 

5 

5 

3 

4 

4 

4 

9 

4.3 

7i -Documentation 

4 

4 

4 

5 

3 

3 

2 

4 

5 

2 

10 

3.6 

7j-Maintenance 

5 

5 

5 

5 

3 

5 

4 

4 

5 

4 

10 

4.5 

7k-Customer 

5 

5 

5 

5 

3 

5 

5 

3 

5 

5 

10 

4.6 

71-Satisfaction 

5 

4 

5 

5 

4 

4 

4 

3 

3 

4 

10 

4.1 

IBM  - ESE 

01 

02 

03 

04 

05 

06 

07 

08 

09 

10 

#R 

Avg.  NotNorml 

7a-Range 

3 

4 

4 

2 

3 

4 

4 

2 

1 

4 

10 

3.1 

7b-CPU 

1 

2 

2 

3 

1 

4 

2 

3 

3 

9 

2.3 

7f-Mainf rame 

2 

3 

3 

1 

3 

2 

4 

2 

2 

4 

10 

2.6 

7g-Ease 

3 

5 

4 

2 

5 

4 

4 

4 

1 

4 

10 

3.6 

7h-Integration 

3 

1 

2 

1 

3 

1 

2 

4 

3 

3 

10 

2.3 

7i -Documentation 

3 

3 

2 

3 

4 

4 

4 

4 

3 

3 

10 

3.3 

7 j -Maintenance 

2 

3 

3 

3 

2 

1 

3 

1 

3 

4 

10 

2.5 

7k-Customer 

2 

1 

4 

2 

4 

2 

5 

2 

4 

5 

10 

3.1  not 

71-Satisfaction 

2 

3 

2 

4 

1 

4 

3 

2 

5 

9 

2.9 

NeuronD  - NEXPERT 

01 

02 

03 

04 

05 

06 

07 

08 

09 

10 

#R 

Avg.  NotNorml 

7a-Range 

5 

4 

4 

4 

3 

5 

5 

5 

4 

4 

10 

4.3 

7b- CPU 

3 

3 

5 

3 

2 

4 

3 

4 

8 

3.4 

7f-Mainf rame 

4 

3 

5 

5 

3 

5 

4 

4 

8 

4.1 

7g-Ease 

3 

2 

5 

4 

3 

4 

4 

5 

4 

3 

10 

3.7 

7h- Integration 

5 

4 

5 

4 

3 

4 

5 

3 

5 

9 

4.2 

7i-Documentation 

3 

3 

4 

2 

2 

3 

3 

4 

2 

2 

10 

2.8 

7j-Maintenance 

4 

3 

5 

4 

2 

3 

3 

4 

3 

3 

10 

3.4 

7k-Customer 

2 

5 

5 

5 

5 

4 

2 

3 

4 

3 

10 

3.8 

71-Satisfaction 

5 

4 

5 

4 

4 

4 

5 

5 

4 

4 

10 

4.4 
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Satisfaction:  Comparing 
Price  with  Overall  Value 


KB  MS  ESE  NEXPERT 


V. 
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Satisfaction:  Customer  Support  and  Hotline 


High 


Neutral 


Low 


KBMS  ESE  NEXPERT 


Note:  Response  distribution  for  LBM-ESE  was  not  normal, 
was  bimodal  around  the  values  2 and  4-5 
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High 


Neutral 


Low 


Satisfaction:  Software  Maintenance 


and  Updates 


INPUT- 
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Satisfaction:  Documentation 


High 


Neutral 


Low 


1 \S  f { £..£ 

AI  Corp.  Aion  ADS 


KB  MS 


3.3 


IBM  Neuron  Data 
ESE  NEXPERT 
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Satisfaction:  Integration  with  Other  Applications 


AI  Corp.  Aion  ADS  IBM  Neuron  Data 
KBMS  ESE  NEXPERT 
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Satisfaction:  Response  Time 


KB  MS  ESE  NEXPERT 
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Satisfaction:  Processor  Resource  Consumption 


High 


Neutral 


Low 


AI  Corp.  Aion  ADS  IBM  Neuron  Data 
KB  MS  ESE  NEXPERT 


V. 
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Neuron  Data— NEXPERT 

Overall  Satisfaction  with  Purchase  of  Product: 

Repeat  Comments 

• Wide  range  of  development  capabilities 

• Useful  object-oriented  environment 

• Portable  (C-based) 

• Good  interfaces  to  applications  and  data  bases 

• Negative:  Some  interface  and  portability  problems 

• Negative:  Some  limits  and  disappointments  throughout 
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IBM— ESE 

Overall  Satisfaction  with  Purchase  of  Product: 

Repeat  Comments 

• Strong,  committed  vendor  and  support 

• Good  for  “simpler”  applications,  easy  to  use 

• Negative:  Missing  many  functions 

• Negative:  No  PC  support 

• Negative:  Not  compiled,  therefore  too  slow 
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Aion — ADS 

Overall  Satisfaction  with  Purchase  of  Product: 

Repeat  Comments 

• Strong  range  of  development  capabilities 

• Easy  to  use  (development)... versus... 

• Negative:  Tough  to  use  (development) 

• Fits  “production”  IBM  delivery  environments 

• Supports  both  PC  and  mainframe;  applications  portable 
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AI  Corp.— KBMS 

Overall  Satisfaction  with  Purchase  of  Product: 

Repeat  Comments 

• Good  overall  functionality 

• Easy  to  use  (development) 

• Effective  natural  language  interface 

• Useful  object-oriented  environment 


V. 
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Number  of  Respondents  Number  of  Respondents 
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Overall  Satisfaction  with  Purchase  of  Product: 
Distribution  of  Responses 


Aion — ADS 


CO 


Neuron  Data — NEXPERT 
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Applications  in  Production 
vs.  in  Development 


Vendor  -Product 

No.  in 
Production 

No.  in 

Development 

AI  Corp.  - KBMS 

0 

6 

Aion  - ADS 

14 

9 

IBM  - ESE 

8 

13 

Neuron  Data  - NEXPERT 

10 

14 
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Marketplace  Application  Distinctions: 
Standalone  vs.  Embedded  vs.  Connected 


Vendor  - Product 

Number  of  Applications 

Standalone 

Embedded 

Connected 

AI  Corp.  - KB  MS 

0 

4 

2 

Aion  - ADS 

11 

3 

9 

IBM  - ESE 

10 

7 

4 

Neuron  Data  - 
NEXPERT 

7 

7 

1 

v 


zesp  n-11 


INPUT 


1 


Which  Types  of  Applications 
Are  Being  Built,  by  Whom 


Mostly  “diagnosing/classifying”  applications 

- Over  50%:  Data  analysis,  interpretation 
(Examples:  Insurance  underwriting,  bank  lending) 

- About  20%:  Use  advising,  procedures 

(Example:  Help  desk) 

- Others:  Controlling,  planning,  configuration, 
simulating 


95%  of  sample:  No  end-users  build  or  modify 
expert  system  applications 

- Almost  always:  “Knowledge  engineers”  were 
programmers 

- Mostly:  Same  person  builds  knowledge  base, 
programs  interfaces,  and  solves  DP  environment 
problems 


Conclusion:  Despite  relative  simplicity  of  applica- 
tions, end-user  development  of  expert  systems  is  a 
“fiction” 


Neuron  Data  - NEXPERT 


Application  Types: 
Detailed  Analysis 


Type  of 
Application 

Number  of 
Mentions 

Examples 

Data  analysis/ 
interpretation 

12 

- Data-cataloging  choices 

- Photo  interpretation 

- Image-feature  extraction 

- Equipment  fault  diagnosis 

- Front-end  to  data  base 

- Signal  analysis 

- Medical  diagnosis/risks 

- Report  generation  from  data 

- Classification 

- Highlighting  budget  issues 

- Production  problems 

Use  advising/ 
procedures 

3 

- Guidance  during 
interviewing 

- Contracts:  Clauses 

- User  interface,  engineering 

Controlling 

4 

- Control  of  VAX  network 

- Control  of  LAN  network 

- Intelligent  user  interface 

- Manufacturing  process 

Simulating 

2 

- Estimating  job  costs 

- Testability  analysis 

Configuration 

1 

- Order  option  configuration 

Scheduling 

2 

- Constuction  project  seq. 

- Avail,  and  use  of  auditors 
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IBM  - ESE 


Application  Types: 
Detailed  Analysis 


Type  of 
Application 

Number  of 
Mentions 

Examples 

Data  analysis/ 
interpretation 

9 

- Insurance  underwriting 

- Policyholder  service 

- Drug-product  selection 

- Credit  scoring 

- Purchase  order 
classification 

- Accounting  assistance 

- Point-scoring,  reports 

- Account  balancing 

Use  advising/ 
procedures 

5 

- Help  desk 

- Travel  expenses 

Controlling 

3 

- Production  control 

Configuration 

2 

- Equipment  config. 

- Option  config. 

Planning 

2 

- Inventory  analysis 

V. 
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Aion  - ADS 


Application  Types: 
Detailed  Analysis 


Type  of 
Application 

Number  of 
Mentions 

Examples 

Data  analysis/ 
interpretation 

15 

- Insurance  underwriting 

- Insurance  claims 

- Credit  and  loan  approval 

- Front-end  for  data  capture 

- Reports,  medical  svcs 

- Product  selec.,  financial 
svcs 

- Risk  evaluation,  loans 

- Filtering  and  sorting  of  data 

- Payroll  witholding 

- Problem  diagnosis 

- Financial  underwriting 

Use  advising/ 
procedures 

6 

- Help  desk 

- Training 

- Assistance  to  programmers 

- Legal  checklist  loans 

- Human  resources 

Controlling 

1 

- DP  room  hardware 
monitoring 

Planning  1 

- Specifications  aid 
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AI  Corp.  - KBMS 


Application  Types: 
Detailed  Analysis 


Type  of 
Application 

Number  of 
Mentions 

Examples 

Data  analysis/ 

5 

- Insurance  underwriting 

interpretation 

- Assistance  to  professionals 

- Customer  service  data  base 

Planning 

1 

- Power  load  forecasting 

v. 
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Application  Types: 
Summary 


Type  of 
Application 

Number  of  Mentions,  by  Product 

AI  Corp. 
KB  MS 

Aion 

ADS 

IBM 

ESE 

Neuron  Data 
NEXPERT 

Data  analysis/ 
interpretation 

5 

15 

9 

12 

Use  advising/ 
procedures 

- 

6 

5 

3 

Controlling 

- 

1 

3 

4 

Simulating 

- 

- 

- 

2 

Configuration 

- 

- 

2 

1 

Planning 

1 

1 

2 

- 

Scheduling 

- 

- 

- 

2 
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at  Time  of  Product  Purchase 
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Decision  Criteria 

Number  of  Mentions  by  Product 

AI  Corp. 
KBMS 

Aion 

ADS 

IBM 

ESE 

Neuron 

Data 

NEXPERT 

Mainfr.  plat. 

2 

6 

6 

PC  plat. 

1 

4 

1 

Other  plat’s 

5 

Portability 

2 

2 

Vendor  rep. 

3 

1 

5 

1 

Cust’r  ref’s 

1 

Tech,  superior. 

2 

4 

3 

Easy  dev’t 

1 

2 

2 

2 

Easy  prod’n 

2 

1 

1 

Appl.  embed/interf. 

4 

2 

1 

DB  access 

2 

1 

' 2 

1 

Natural  lang. 

1 

Specific  feat. 

1 

. 1 

Operating  sys. 

2 

1 

Fits  appli. 

1 

Low  cost 

3 

1 

Easy  proto ’g 

2 

No  other  cons’d 

1 
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Hardware  and  Software  Platforms 
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Vendor  - 

Hardware 

Operating 

Transaction 

Product 

Systems 

Processing 

AI  Corp  - 

Mainframe 

MVS/XA,  VM 

CICS,  TSO, 

KBMS 

4/89:  PC 

OS/2 

IMS/DC, 

IDMS/DC, 

CMS 

Aion  - 

Mainframe, 

MVS,  VM 

CICS,  TSO, 

ADS 

PC  | 

DOS,  OS/2 

IMS 

IBM- 

Mainframe 

MVS,  VM 

CICS,  TSO, 

ESE 

3/89:  PC 

OS/2 

IMS,  CMS 

Neuron 

Mainframe 

VM 

SQL/DS 

Data  - 

2Q89:  MVS 

CICS,  TSO, 

NEXPERT 

Mac,  VAX, 
Unix  work- 
stations 

IMS 

PC 

OS/2 
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Who  was  Interviewed: 

Job  Functions  and  Industries 

Job  functions  (across  vendors) 

- Half:  Management  of  knowledge 
base  application  development 

- Half:  Hands-on  developers 

AI  Corp.  - KBMS 

- 4:  Financial  services 

- 1 : Telecommunications 

- 1 : Electric  Utility 

Aion  - ADS 

- 6:  Financial  services 

- 2:  Software 

- 2:  Petroleum 

IBM  - ESE 

- 5:  Financial  services 

- 2:  Manufacturing 

- 1 : Pharmaceuticals 

- 1 : Telecommunications 

- 1 : State  government 

Neuron  Data  - NEXPERT 

- 4:  Software 

- 2:  Chemicals  processing 

- 1 : Health  care 

- 1 : Forest  products 

- 1 : Construction 

- 1 : Aerospace 


Management  Presentation: 
Outline 


Who  was  interviewed 
Hardware  and  software  platforms 
Key  purchase  criteria 
Types  of  applications 
Who  builds  the  applications? 

Marketplace:  Standalone  vs.  embedded  vs.  connected 
Applications:  Production  vs.  development 
Overall  satisfaction  with  products 
Satisfaction:  Specific  questions 
Product-by-product  strengths  and  weaknesses 
Product-by-product  missing  features 
Who  is  at  the  “state  of  the  art”? 

Vendor  interviews:  Today’s  product,  and  the  next  release 

Vendor  interviews:  Future  directions 

Input’s  view:  Product  positions  and  movement 

INPUT- 
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High-Level  IBM  Competitive  Options 
for  Evaluation 


1.  Radically  strengthen  ESE 

2.  Plan  to  shift  ESE  users  to  IBM/KEE  (?) 

3.  Reposition  and  enhance  IBM/Knowledge  Tool  (?) 

4.  Purchase/remarket  another,  more  competitive 
product 
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High-Level  IBM  Competitive  Options 
for  Evaluation 


4.  Purchase/remarket  another,  more  competitive 
product 

- Is  any  of  the  other  three  products  analyzed  here 
available  to  IBM? 

- Functionality  of  another  product,  vs.  IBM/KEE  or 
IBM/Knowledge  Tool? 

- Which  other  vendors/products  should  be  considered? 
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High-Level  IBM  Competitive  Options 
for  Evaluation 


3.  Reposition  and  enhance  IBM/Knowledge  Tool  (?) 

- How  comprehensive  are  its  AI  functions? 

- Can  it  connect,  as  well  as  be  embedded? 

- How  good  are  its  mainframe  production  functions 
and  efficiency? 

- How  adequate  are  its  interfaces  and  mainframe/PC 
portability? 
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High-Level  IBM  Competitive  Options 
for  Evaluation 


2.  Plan  to  shift  ESE  users  to  IBM/KEE  (?) 

- What  are  the  gaps  in  IBM/KEE  AI  functions? 

- How  good  are  its  mainframe  production  functions 
and  efficiency? 

- How  adequate  are  its  interfaces  and  mainframe/PC 
portability? 
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High-Level  IBM  Competitive  Options 
for  Evaluation 


1.  Radically  strengthen  ESE 

- Positioning:  Give  up  “fiction”  of  end-user 
development 

- Can  ESE  be  strengthened  enough  to  compete? 

- Has  Aion  closed  ESE’s  competitive  window? 
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Bicycling  “Racing  Machine”  Images, 
Suggesting  Comparative  Capabilities 

AI  Corp.  - KBMS:  “In  its  limited  use  so  far,  looks  like  a 


great  three-speed  bicycle” 

Aion-ADS: 

“In  the  city  or  up  and  down  mountains, 
the  top  all-purpose  choice  for  serious 
bikers” 

IBM  - ESE 

“A  good  kid’s  bike  with  a fine  set  of 
training  wheels” 

Neuron  Data  - 
NEXPERT 

“Could  be  used  for  the  Tour 
de  France,  although  the  gear  ratio  has 
some  annoying  gaps” 

ZESP 1-20 
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The  Vendor  Behind  the  Product: 
Users’  Perceptions 


AI  Corp. 

- Consistently  strong  technical-support  organization 

- To  most  users,  a “newcomer”  with  a good  initial 
product  entry 

- To  co-developers,  a fully  supportive  partner 

- To  users  of  “Intellect”  natural-language  product,  a 
solid  vendor 


• Aion 

- A company  that  plans  well  and  delivers  on  its 
promises 

- A good  blend  of  AI  savvy  and  production-environment 
sensitivity 

- An  involved  and  thoughtful  management  team  that 
listens 

- Responsive  and  knowledgable  technical  staffers 


• IBM 

- The  mainframe  vendor  that  they  and  their  DP  shop 
depend  on 

- A disappointing  AI  software  vendor 

- Good  or  poor  product  supporters,  depending  on  the 
local  SE 

- Strong  trainers 


V 


Neuron  Data 

- Channel  confusion:  “Whose  product  is  this,  anyway?” 

- Technically  astute  in  AI  functions,  but  disjointed  on 
support 

- In  breadth  of  offerings,  documentation  is  shallow 

- Some  disappointments  on  promised  non-AI  functions 
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Cross  Comparison  of  Products: 
Strong  Capabilities 
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Capability 

AI  Corp. 
KBMS 

Aion 

ADS 

IBM 

ESE 

Neuron  Data 
NEXPERT 

AI  functions 

X 

X 

X 

Easy  to  learn 

X 

X 

X 

X 

Ease  of  dev. 

X 

X 

X 

X 

Object-or.  dev. 

X 

X* 

X 

Graphics-b.  dev. 

X 

Modular  dev. 

X* 

X 

User  graphics 

X 

X* 

Prod’n  func. 

X* 

X 

X* 

Mainframe-based 

X 

X 

X 

X* 

Portab.  MF/PC 

X* 

X 

X 

X* 

640K+  memory 

X* 

X 

X* 

X 

Coop.  proc. 

X* 

X 

X 

Wide  interfaces 

X 

X 

X 

Bug-free 

X 

X 

Crash-free 

X 

Strong  vendor 

X 

X 

Superior  support 

X 

Estab.  product 

X 

X 

Notes  - means  planned  for  next  release: 

AI  Corp.  - KB  MS:  April  1989 

Aion  - ADS:  Summer  1989 

IBM-ESE:  March  1989 

Neuron  Data  - NEXPERT:  Summer  1989 
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Companies  and  Products: 
Quantitative  Overview 


Company  - 
Product 

1988 

Company 
Revenues 
($  Millions) 

Number  of 
Employees 

Product 
Licenses 
to  Firms 

AI  Corp.  - 

$15 

90 

25 

KBMS 

Aion  - 

$10 

100 

200 

ADS 

(est.) 

IBM- 

$60,000 

385,000 

200 

ESE 

Neuron 

N/A 

50 

9 

• 

Data  - 

(4,000  copies) 

NEXPERT 

v 


INPUT*  ^ 


ZESPI-5 


r 


Research  Methodology 
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• Performed  by  outside  firm:  INPUT 

- International  market  research  and  consulting  firm 

- 15  years  old;  privately  owned 

- Information  industries  specialists 

- Project  team:  Two  seniors,  each  with  hands-on  expert 
systems  background 

• In-depth  telephone  interviews  (36  users,  total) 

- Early  January  1989 

- Carefully  qualified  interviewees 

- Average:  30  minutes  each 

- 3 products:  10  interviews  each 

- 1 product  (new):  6 interviews 

• Each  vendor:  2 to  4 interview  contacts 

• User  questionnaire  development 

- 15  pages,  35  main  topics  j 

- IBM  review,  INPUT  revision  ! 

- Pre-test  validation 

• Analysis  and  report  writing 

- Analysis  objective:  Competitive  patterns,  not  statistics 

- Emphasis:  Strengths  and  weaknesses  (qualitative) 

- Found  highly  consistent  responses 

- Result:  Picture  of  buyers’  perceptions  of  each  product 

- Averaging  of  numeric  ratings 

- Competitive  cross  comparisons 

- Other  information 

- Patterns,  trends,  IBM  options 
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Outline 
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Research  objectives  and  methods 
Industry  overview  and  product  histories 
Company  overviews 


Types  of  knowledge  base  applications 

Product  overviews:  Satisfaction,  strengths  and 
weaknesses 


AI  Corp.  - KBMS 

Aion  - ADS 

IBM  - ESE 

Neuron  Data  - NEXPERT 


• Product  and  vendor  cross  comparisons 

• Product  directions  and  positions 

• High-level  competitive  options 


v 
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